-- Logs begin at Wed 2022-08-10 22:00:58 UTC, end at Wed 2022-08-10 23:16:09 UTC. -- Aug 10 22:39:01.917582 dv-cinder-836083-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 22:39:01.925054 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 22:39:01.927093 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 22:39:01 2022] *** Aug 10 22:39:01.927093 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 22:39:01.927093 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 22:39:01.927093 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: nodename: dv-cinder-836083-12-iscsi Aug 10 22:39:01.927093 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: machine: x86_64 Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: clock source: unix Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: pcre jit disabled Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: detected number of CPU cores: 4 Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: current working directory: / Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: detected binary path: /usr/bin/uwsgi-core Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: your processes number limit is 47680 Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: your memory page size is 4096 bytes Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: detected max file descriptor number: 2048 Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: lock engine: pthread robust mutexes Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: thunder lock: enabled Aug 10 22:39:01.927457 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 22:39:01.928425 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 22:39:01.969039 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: Python main interpreter initialized at 0x55bc999c29c0 Aug 10 22:39:01.969039 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: python threads support enabled Aug 10 22:39:01.969039 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: your server socket listen backlog is limited to 100 connections Aug 10 22:39:01.969039 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: your mercy for graceful operations on workers is 90 seconds Aug 10 22:39:01.969459 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 22:39:01.969537 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: *** Operational MODE: preforking *** Aug 10 22:39:01.969775 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: *** uWSGI is running in multiple interpreter mode *** Aug 10 22:39:01.969775 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: spawned uWSGI master process (pid: 117455) Aug 10 22:39:01.969988 dv-cinder-836083-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 22:39:01.970544 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: spawned uWSGI worker 1 (pid: 117456, cores: 1) Aug 10 22:39:01.972122 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: spawned uWSGI worker 2 (pid: 117457, cores: 1) Aug 10 22:39:01.972122 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 22:39:02.636142 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:39:02.638243 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:39:03.722820 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:39:03.722820 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: from cryptography.utils import int_from_bytes Aug 10 22:39:03.723505 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:39:03.723505 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: from cryptography.utils import int_from_bytes Aug 10 22:39:03.724908 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:39:03.724908 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: from cryptography.utils import int_from_bytes Aug 10 22:39:03.725525 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:39:03.725525 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: from cryptography.utils import int_from_bytes Aug 10 22:39:06.216271 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:39:06.216952 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:39:06.217061 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:39:06.217395 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:39:06.217646 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:39:06.218027 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.218344 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.218657 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.218966 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.219286 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.219545 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:39:06.219937 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.220019 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:39:06.220086 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.220188 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.220334 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:39:06.220521 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.220670 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:39:06.220764 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.220929 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:39:06.221259 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.221477 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.221619 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-12-iscsi {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.221780 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.221916 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.222067 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.222205 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.222361 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.222507 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.222666 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.222813 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.222961 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.223115 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.223264 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.223414 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.223552 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.223703 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.223840 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.224047 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.224201 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.224435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.224618 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.224790 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-12-iscsi {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.224983 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.225166 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.225395 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.225575 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.225801 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.225942 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.226216 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.226362 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.226362 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.226638 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.226773 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.226927 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.227061 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.227211 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.227352 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.227532 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.227689 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.227848 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.227997 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-12-iscsi {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.228138 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.228286 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.228467 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.228604 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.228745 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.228929 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.229063 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.229328 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.229491 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.229643 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.229940 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.230187 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.230319 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.230461 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.230589 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.230773 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.230916 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.231076 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.231227 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.231364 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-12-iscsi {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.231454 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.231545 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.231853 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.231959 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.232161 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.232250 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.232504 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.232600 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.232803 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.232899 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.233106 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.233358 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.233472 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.233594 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.233726 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.233879 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.234022 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.234186 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.234283 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.234510 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.234596 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.234826 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.234914 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.235140 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.235236 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.235451 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.235547 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.235695 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.235784 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.235937 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.236027 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.236245 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.236331 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.236557 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.236657 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.236855 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.236950 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.237152 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.237240 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.237472 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.237559 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.237771 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.237866 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.238070 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.238164 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.238367 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.238491 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.238663 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.238754 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.238929 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.239016 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.239178 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.239275 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.239496 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.239656 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.239811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.239899 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.240116 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.240205 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.240418 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.240513 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.240718 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.240805 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.241018 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.241107 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.241335 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.241427 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.241640 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.241737 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.241942 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.242041 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.242242 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.242329 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.242548 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.242635 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.242856 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.242951 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.243152 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.243239 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.243449 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.243546 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.243746 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.243841 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.244054 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.244147 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.244374 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.245005 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.245208 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.245375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.245530 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.245697 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.245822 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.245989 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.246131 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.246300 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.246399 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.246609 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.246696 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.246905 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.246994 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.247200 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.247287 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.247496 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.247629 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.247791 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.247890 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.248086 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.248187 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.248382 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.248479 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.248676 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.248765 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.248946 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.249033 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.249244 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.249383 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.249565 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.249699 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.249862 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.249966 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.250155 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.250258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.250459 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.250558 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.250757 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.250844 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.251052 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.251149 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.251348 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.251490 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.251640 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.251807 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.251936 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.252083 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.252234 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.252329 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.252528 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.252616 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.252823 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.252919 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.253121 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.253207 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.253438 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.253529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.253736 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.253824 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.254042 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.254143 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.254338 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.254433 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.254634 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.254723 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.254929 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.255014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.255217 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.255303 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.255512 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.255614 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.255818 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.255905 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.256113 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.256244 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.256406 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.256501 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.256697 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.256785 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.256991 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.257079 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.257388 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.257484 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.257603 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.257692 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.257894 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.257981 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.258187 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.258283 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.258477 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.258572 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.258777 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.258873 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.259083 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.259178 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.259383 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.259469 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.259683 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.259808 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.259979 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.260151 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.260942 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.261112 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.261304 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.261477 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.261758 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.261849 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.262067 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.262156 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.262368 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.262466 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.262671 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.262759 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.262968 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.263063 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.263281 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.263371 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.263595 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.263683 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.263903 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.263990 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.264205 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.264303 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.264505 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.264763 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.264852 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.264932 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:39:06.265101 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.265190 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.265433 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.265525 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.265745 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.265834 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.266067 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.266158 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.266379 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.266479 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.266685 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.266788 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.266995 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.267096 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.267300 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.267396 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.267616 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.267740 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.267936 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.268025 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.268248 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.268337 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.268548 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.268644 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.268852 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.268947 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.269171 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.269259 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.269509 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.269612 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.269827 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.269984 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.270138 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.270225 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.270442 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.270539 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.270745 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.270842 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.271048 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.271144 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.271360 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.271458 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.271685 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.271772 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.271986 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.272081 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.272294 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.272390 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.272598 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.272684 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.272902 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.272996 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.273204 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.273323 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.273534 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.273623 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.273836 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.273935 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.274164 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.274254 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.274474 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.274568 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.274779 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.274866 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.275082 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.275182 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.275391 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.275480 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.275744 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.275853 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.276140 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.276310 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.276462 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.276570 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.276728 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.276834 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.277024 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.277121 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.277364 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.277475 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.277648 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.277746 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.277945 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.278044 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.278256 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.278344 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.278573 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.278675 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.278872 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.278969 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.279198 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.279294 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.279496 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.279585 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.279799 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.279951 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.280101 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.280192 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.280403 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.280492 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.280702 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.280788 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.281003 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.281091 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.281326 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.281415 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.281627 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.281722 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.281941 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.282028 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.282241 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.282366 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.282540 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.282629 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.282852 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.282955 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.283150 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.283247 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.283448 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.283536 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.283752 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.283848 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.284110 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.284213 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.284404 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.284654 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.284738 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.284830 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.284922 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.285005 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.285220 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.285343 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.285562 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.285671 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.285862 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.285951 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.286164 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.286254 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.286483 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.286650 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.286783 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.286872 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.287083 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.287184 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.287394 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.287527 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.287701 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.287839 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.287997 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.288211 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.288310 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.288519 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.288615 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.288823 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.288940 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.289160 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.289259 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.289484 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.289575 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.289792 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.289881 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.290178 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.290280 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.290438 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.290535 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.290757 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.290853 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.291076 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.291172 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.291472 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.291604 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.291830 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.291982 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.292146 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.292297 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.292438 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.292689 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.292777 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.292998 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.293102 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.293321 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.293414 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.293658 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.293761 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.293942 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.294029 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.294630 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.294713 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.294796 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.294875 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.294964 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.295046 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.295582 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.295678 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.295760 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.295840 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.295918 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296000 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296087 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296169 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296280 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296369 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296619 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296752 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.296923 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.297011 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.297245 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.297367 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.297578 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.297683 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.297892 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.298029 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.298196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.298303 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.298507 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.298600 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.298811 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.298899 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.299119 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.299228 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.299416 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.299504 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.299726 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.299821 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.300036 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.300133 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.300354 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.300455 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.300659 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.300748 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.300972 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.301136 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.301273 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.301384 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.301598 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.301686 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.301903 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.301990 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.302206 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.302283 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.302563 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.302660 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.302805 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.302894 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.303376 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.303470 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.303679 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.303769 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.303990 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.304070 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.304293 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.304381 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.304607 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.304695 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.304914 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.305069 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.305219 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.305476 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.305579 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.305662 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.305824 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.305915 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.306128 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.306214 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.306442 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.306539 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.306743 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.307433 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.307582 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.307875 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.308038 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.308206 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.308365 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.308482 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.308580 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.308796 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.308884 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.309097 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.309187 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.309438 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.309542 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.309766 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.309855 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.310074 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.310152 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.310392 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.310518 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.310696 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.310811 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.311086 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.311174 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.311266 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.311349 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.312442 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.312580 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.312668 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313254 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313376 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313463 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313545 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313644 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313729 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313892 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.313980 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314062 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314152 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314235 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314323 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314405 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314485 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314580 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314663 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314743 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314823 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314911 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.314992 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.315087 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.315176 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.315374 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.315488 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.315674 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.315763 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.315971 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.316052 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.316294 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.316369 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.316597 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.316674 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317069 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317162 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317232 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317325 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317527 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317633 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317833 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.317930 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.318135 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.318223 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.318437 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.318541 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.318739 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.318827 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.319080 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.319200 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.319380 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.319509 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.319680 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.319778 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.319982 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.320078 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.320283 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.320384 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.320587 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.320688 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.320886 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.320974 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.321190 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.321298 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.321548 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.321647 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.321823 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.321902 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.322128 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.322221 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.322721 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.323364 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.323485 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.323743 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.323926 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.324080 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.324315 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.324410 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.324681 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.324987 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.325184 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.325327 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.325623 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.325712 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.325925 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.326018 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.326230 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.326337 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.326547 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.326658 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.326974 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.327120 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.327302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.327455 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.327625 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.327770 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.327962 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.328088 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.328267 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.328403 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.328578 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.328717 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.328881 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.329045 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.329184 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.329406 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.329517 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330128 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330299 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330402 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330494 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330577 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330668 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330737 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330803 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.330962 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.331051 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.331229 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.331317 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.331532 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.331617 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.331830 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.331918 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.332132 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.332222 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.332429 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.332506 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.332731 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.332824 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.333029 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.333123 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.333356 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.333448 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.333659 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.333776 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.333963 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.334084 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.334267 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.334374 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.334561 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.334659 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.334862 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.334958 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.335182 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.335271 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.335487 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.335590 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.335790 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.335878 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.336092 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.336189 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.336392 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.336489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.336712 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.336823 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.337033 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.337295 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.337440 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.337607 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.337717 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.337909 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.338055 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.338260 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.338517 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.338734 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.338896 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.339043 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.339180 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.339270 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.339425 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.339524 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.339725 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.339814 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.340027 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.340125 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.340334 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.340471 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.340643 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.340758 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.340946 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.341073 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.341245 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.341360 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.341575 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.341680 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.341880 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.341991 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.342176 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.342265 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.342473 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.342560 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.342775 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.342873 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.343076 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.343163 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.343371 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.343461 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.343674 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.343764 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.343970 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.344126 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.344272 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.344368 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.344568 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.344657 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.344870 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.344969 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.345163 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.345239 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.345490 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.345570 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.345793 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.345928 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.346092 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.346182 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.346401 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.346561 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.346699 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.346827 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.346983 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.347135 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.347268 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.347393 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.347568 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.347709 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.347864 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.348011 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.348155 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.348288 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.348431 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.348576 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.348751 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.348903 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.349037 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.349182 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.349405 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.349551 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.349687 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.349838 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.349977 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.350125 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.350276 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.350411 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.350638 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.350813 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.350916 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.350996 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.351065 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.351131 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.351363 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.351463 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.351641 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.351721 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.351983 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.352071 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.352228 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.352307 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.352541 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.352630 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.352840 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.352929 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.353135 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.353224 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.353464 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.353573 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.353763 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.353900 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.354139 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.354325 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.354477 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.354629 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.354766 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.354852 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.355064 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.355161 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.355371 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.355460 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.355672 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.355807 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.355973 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.356060 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.356275 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.356363 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.356581 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.356678 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.356878 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.356966 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.357185 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.357273 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.357509 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.357599 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.357813 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.357901 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.358110 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.358198 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.358412 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.358509 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.358715 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.358801 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.359014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.359102 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.359315 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.359408 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.359620 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.359706 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.359920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.360008 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.360221 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.360310 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.360612 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.360717 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.360821 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.360910 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.361121 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.361211 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.361461 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.361562 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.361761 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.361865 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.362062 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.362151 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.362362 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.362450 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.362665 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.362834 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.362965 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.363065 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.363267 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.363343 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.363584 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.363688 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.363863 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.363943 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.364164 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.364253 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.364464 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.364724 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.364817 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.364899 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.365058 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.365146 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.365381 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.365484 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.365680 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.365769 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.365980 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.366068 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.366275 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.366364 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.366573 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.366661 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.366869 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.366956 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.367187 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.367298 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.367487 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.367600 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.367791 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.367900 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.368091 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.368181 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.368407 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.368659 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.368850 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.369055 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.369055 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.369345 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.370134 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.370269 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.370401 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.370751 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.370751 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371064 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371064 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371204 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371272 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371353 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371550 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371706 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371801 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.371883 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.372037 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.372137 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.372337 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.372521 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.372652 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.372828 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.372947 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.373136 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.373232 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.373470 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.373560 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.373770 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.373874 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.374069 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.374158 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.374375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.374502 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.374691 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.374798 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.374990 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.375102 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.375290 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.375384 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.375594 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.375795 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376045 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376198 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376331 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376421 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376680 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376885 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.376975 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.377191 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.377346 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.377518 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.377608 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.377889 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.377982 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.378191 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.378287 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.378506 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.378595 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.378821 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.378922 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.379126 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.379213 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.379431 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.379520 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.379728 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.379818 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.380034 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.380120 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.380339 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.380425 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.380642 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.380730 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.380954 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.381049 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.381258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.381427 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.381607 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.381750 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.381879 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.381973 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.382192 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.382293 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.382954 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383073 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383159 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383240 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383330 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383421 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383421 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383569 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383756 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.383858 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.384058 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.384161 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.384374 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.384470 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.384674 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.384767 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.384977 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.385148 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.385956 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.386124 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.386327 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.386481 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.386624 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.386702 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.386908 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.386998 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.387222 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.387311 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.387521 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.387611 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.387827 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.387914 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.388131 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.388219 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.388436 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.388523 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.388737 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.388876 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.389038 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.389137 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.389374 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.389466 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.389677 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.389763 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.389975 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.390076 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.390274 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.390369 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.390570 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.390659 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.390902 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.390997 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.391201 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.391288 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.391514 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.391602 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.391857 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.391962 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.392116 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.392266 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.392419 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.392515 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.392719 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.392810 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.393052 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.393140 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.393376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.393466 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.393698 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.393789 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394101 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394314 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394410 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394615 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394698 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394921 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.394999 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.395221 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.395320 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.395522 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.395617 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.395821 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.395908 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.396121 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.396221 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.396418 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.396506 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.396715 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.396810 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.397012 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.397108 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.397353 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.397446 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.397656 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.397745 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.397957 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.398053 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.398262 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.398350 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.398561 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.398649 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.398863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.398959 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.399157 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.399243 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.399480 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.399574 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.399779 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.399867 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.400094 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.400182 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.400873 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.401001 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.401001 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.401258 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.401465 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.401619 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.401745 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.401849 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402041 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402141 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402141 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402291 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402423 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402523 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402607 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402694 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402828 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.402917 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.403130 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.403228 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.403436 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.403532 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.403745 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.403833 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.404056 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.404155 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.404398 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.404623 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.404713 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.404948 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.405036 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.405256 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.405371 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.405584 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.405673 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.405891 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.405994 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.406205 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.406314 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.406507 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.406761 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.406859 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.407087 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.407189 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.407398 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.407493 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.407703 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.407793 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.408010 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.408098 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.408321 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.408411 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.408631 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.408719 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.408941 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.409031 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.409255 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.409363 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.409585 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.409757 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.409892 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.409981 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.410200 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.410295 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.410526 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.410627 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.410846 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.410935 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.411145 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.411236 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.411863 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.411977 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412108 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412198 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412280 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412361 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412460 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412532 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412629 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412718 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.412933 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.413034 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.413239 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.413392 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.413583 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.413674 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.413884 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.413983 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.414192 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.414295 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.414500 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.414629 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.414816 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.414942 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.415143 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.415261 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.415451 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.415565 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.415757 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.415873 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.416060 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.416176 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.416395 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.416537 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.416903 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.417097 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.417318 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.417498 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.417614 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.417882 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.418066 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.418248 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.418432 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.418595 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.418768 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.418954 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.419097 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.419208 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.419391 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.419571 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.419767 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.419964 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.420151 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.420320 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.420471 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.420615 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.420757 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.420913 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.420913 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.421198 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.421379 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.421590 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.421762 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.421928 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.422080 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.422296 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.422296 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.422543 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.422702 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.422838 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.422928 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.423017 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.423118 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.423265 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.423420 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.423571 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.423732 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.423888 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.424026 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.424152 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.424296 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.424456 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.424597 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.424746 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.424990 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.425108 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.425363 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.425477 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.425660 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.425785 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.425991 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.426232 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.426328 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.426545 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.426650 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.426848 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.426951 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.427150 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.427244 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.427456 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.427573 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.427769 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.427860 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.428321 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.428412 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.428632 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.428761 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.428932 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.429301 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.429413 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.429594 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.429713 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.429932 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.430035 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.430219 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.430308 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.430478 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.430567 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.430745 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.430845 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.431034 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.431124 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.431330 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.431423 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.431681 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.431779 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.432780 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.433418 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.433510 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.433593 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.433673 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.433770 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.433853 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.433934 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434023 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434104 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434184 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434278 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434361 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434440 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434520 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434608 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434801 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.434911 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.435103 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.435203 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.435453 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.435558 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.435769 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.435866 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.436071 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.436177 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.436374 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.436478 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.436676 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.436782 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.436977 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.437073 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.437310 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.437424 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.437635 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.437714 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.437958 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.438191 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.438271 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.438615 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.438757 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.438896 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.439033 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.439170 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.439309 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.439526 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.439666 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.439801 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.439974 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.440063 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.440298 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.440455 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.440608 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.440752 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.440893 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.441037 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.441200 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.441368 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.441528 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.441663 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.441847 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.441956 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.442133 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.442223 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.442440 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.442588 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.442828 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.442993 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.443151 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.443299 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.443455 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.443611 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.443758 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.443903 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.444069 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.444216 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.444379 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.444529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.444680 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.444835 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.444982 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.445135 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.445321 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.445488 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.445637 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.445797 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.445946 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.446104 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.446250 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.446396 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.446541 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.446697 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.446843 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.446988 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.447134 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.447279 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.447432 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.447633 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.448333 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.448491 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.448638 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.448784 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.448944 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.449092 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.449237 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.449411 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.449563 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.449711 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.449868 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.450059 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.450210 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.450356 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.450516 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.450671 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.450819 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.450964 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.451109 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.451263 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.451410 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.451565 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.451714 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.451861 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.452157 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.452311 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.452476 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.452636 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.452793 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.453032 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.453186 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.453400 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.453575 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.453731 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.453877 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.454024 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.454170 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.454315 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.454479 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.454627 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.454772 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.454926 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.455074 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.455228 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.455384 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.455531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.455676 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.455827 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.455973 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.456128 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.456275 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.456438 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.456585 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.456730 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.456883 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.457037 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.457184 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.457352 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.457505 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.457651 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.457797 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.457960 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.458108 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.458253 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.458408 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.458408 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.458693 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.458849 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.458996 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.459143 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.459287 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.459432 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.459587 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.459733 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.459878 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.460023 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.460223 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.460383 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.460539 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.460685 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.460831 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.460976 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.461121 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.461267 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.461475 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.461622 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.461767 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.461912 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462057 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462212 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462372 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462537 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462692 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462838 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462991 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.462991 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.463891 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.464039 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.464184 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.464330 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.464517 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.464707 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.464866 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.465021 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.465168 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.465337 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.465503 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.465659 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.465807 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.465952 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.466097 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.466242 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.466431 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.466597 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.466751 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.466916 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.467065 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.467210 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.467363 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.467510 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.467662 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.467809 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.467953 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.468104 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.468265 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.468412 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.468558 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.468716 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.468861 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.469006 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.469230 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.469423 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.469572 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.469730 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.469876 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.470030 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.470177 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.470367 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.470514 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.470659 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.470828 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.470999 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.471146 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.471291 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.471435 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.471580 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.471726 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.471880 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.472027 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.472172 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.472319 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.472475 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.472641 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.472788 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.472933 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.473079 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.473244 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.473421 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.473580 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.473727 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.473873 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.474020 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.474165 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.474311 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.474484 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.474632 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.474778 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.474924 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.475069 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.475214 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.475369 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.475522 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.475669 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.475814 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.475960 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.476114 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.476268 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.476436 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.476590 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.476745 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.476893 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.477048 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.477194 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.477366 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.477515 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.477661 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.477806 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.477964 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.478111 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.478266 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.478418 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:39:06.478565 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.478565 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.478565 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.478565 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.478565 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.479933 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.479933 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:39:06.479933 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:39:06.642432 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO dbcounter [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Registered counter for database nova_api Aug 10 22:39:06.643680 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO dbcounter [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Registered counter for database nova_api Aug 10 22:39:06.663135 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.665212 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_db.sqlalchemy.engines [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.670677 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writer thread running {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:06.672691 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writer thread running {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:06.726527 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.context [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c55dad4d-2bd6-411b-a14d-21f8d7cc466a(cell1) {{(pid=117456) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:39:06.728570 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.context [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c55dad4d-2bd6-411b-a14d-21f8d7cc466a(cell1) {{(pid=117457) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:39:06.730846 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_concurrency.lockutils [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:39:06.731318 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_concurrency.lockutils [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:39:06.732865 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_concurrency.lockutils [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:39:06.733173 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:39:06.733609 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_concurrency.lockutils [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:39:06.733718 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:39:06.734050 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_concurrency.lockutils [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:39:06.735254 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:39:06.736025 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_concurrency.lockutils [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:39:06.736119 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:39:06.736535 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:39:06.738064 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO dbcounter [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Registered counter for database nova_cell0 Aug 10 22:39:06.738554 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:39:06.740576 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO dbcounter [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Registered counter for database nova_cell0 Aug 10 22:39:06.743631 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO dbcounter [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Registered counter for database nova_cell1 Aug 10 22:39:06.747888 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO dbcounter [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Registered counter for database nova_cell1 Aug 10 22:39:06.752015 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.754543 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.755768 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_db.sqlalchemy.engines [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.758108 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writer thread running {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:06.759313 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_db.sqlalchemy.engines [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.761389 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writer thread running {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:06.899078 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writer thread running {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:06.900960 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writer thread running {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:06.908425 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO dbcounter [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Registered counter for database nova_cell0 Aug 10 22:39:06.910437 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO dbcounter [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Registered counter for database nova_cell0 Aug 10 22:39:06.918232 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG oslo_db.sqlalchemy.engines [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.921879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_db.sqlalchemy.engines [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:39:06.922831 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writer thread running {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:06.926509 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writer thread running {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:39:07.266889 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: WARNING keystonemiddleware.auth_token [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:39:07.267652 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: WARNING keystonemiddleware.auth_token [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:39:07.274131 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: WARNING keystonemiddleware.auth_token [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:39:07.274938 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: WARNING keystonemiddleware.auth_token [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:39:07.619460 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: WARNING keystonemiddleware.auth_token [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:39:07.620276 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: WARNING keystonemiddleware.auth_token [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:39:07.625931 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: WARNING keystonemiddleware.auth_token [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:39:07.626131 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: WARNING keystonemiddleware.auth_token [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:39:07.631169 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc999c29c0 pid: 117456 (default app) Aug 10 22:39:07.631341 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc999c29c0 pid: 117457 (default app) Aug 10 22:39:07.633230 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:39:07.634416 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-46e6a7e8-1193-45ab-a1e5-6c7d506ab24d None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Aug 10 22:39:07.634824 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Wed Aug 10 22:39:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:25.249424 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:25.251242 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002683 Aug 10 22:40:25.256220 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:25.263575 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writing DB stats nova_api:SELECT=3 {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:25.264438 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writing DB stats nova_cell1:SELECT=3 {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:25.265577 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writing DB stats nova_cell0:SELECT=3 {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:25.266422 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:26.151530 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-8b7b2d72-f9ce-432b-8b19-39f2bb635d7d admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:26.184480 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-8b7b2d72-f9ce-432b-8b19-39f2bb635d7d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.926111 Aug 10 22:40:26.185803 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 2/3] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 10 22:40:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:28.437871 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:28.438628 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-e3b91da2-84cf-4401-bf7a-6cc1a809e8af None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 10 22:40:28.440462 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 2/4] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:28.921481 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-73733203-582b-4012-8b03-50da4bed57e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:28.943763 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:40:28.943763 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: warnings.warn(msg) Aug 10 22:40:28.972295 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-73733203-582b-4012-8b03-50da4bed57e5 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.526825 Aug 10 22:40:28.973945 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 3/5] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:40:28.987497 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_api:SELECT=3 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:28.989462 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_cell0:SELECT=3 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:28.990556 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_cell1:SELECT=3 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:28.991376 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:29.206146 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-f8a27ae6-af7a-426c-9190-25a281cdff72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:29.211027 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:40:29.211027 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: warnings.warn(msg) Aug 10 22:40:29.273953 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-f8a27ae6-af7a-426c-9190-25a281cdff72 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291593 Aug 10 22:40:29.284269 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 3/6] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 10 22:40:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:31.578148 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-73733203-582b-4012-8b03-50da4bed57e5 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:31.579083 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-73733203-582b-4012-8b03-50da4bed57e5 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 10 22:40:31.579482 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 4/7] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:40:32.255681 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-46c083bb-4848-44cc-a94f-456f973a3085 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "vcpus": 1, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:32.275848 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:40:32.275848 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: warnings.warn(msg) Aug 10 22:40:32.296387 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-46c083bb-4848-44cc-a94f-456f973a3085 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.709234 Aug 10 22:40:32.296979 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 4/8] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:32.310176 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-621e572e-cf24-42aa-ba85-af6924faffdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:32.313705 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:40:32.313705 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: warnings.warn(msg) Aug 10 22:40:32.353208 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-621e572e-cf24-42aa-ba85-af6924faffdb admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046654 Aug 10 22:40:32.354027 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 5/9] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 10 22:40:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:34.646902 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-46c083bb-4848-44cc-a94f-456f973a3085 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:34.647784 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-46c083bb-4848-44cc-a94f-456f973a3085 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 22:40:34.649630 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:35.045225 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-080ffa10-556a-4092-8695-d4d71ae9a62b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "disk": 10}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:35.064991 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-080ffa10-556a-4092-8695-d4d71ae9a62b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.410256 Aug 10 22:40:35.066384 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 6/11] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:35.080034 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-a226b03f-0f4e-4a18-8449-00d16d13a051 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:35.105837 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-a226b03f-0f4e-4a18-8449-00d16d13a051 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031046 Aug 10 22:40:35.106603 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 6/12] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 10 22:40:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:37.336649 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-080ffa10-556a-4092-8695-d4d71ae9a62b admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:37.337693 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-080ffa10-556a-4092-8695-d4d71ae9a62b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 10 22:40:37.338348 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 7/13] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:37.782302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-7b702ac2-2239-4c5f-aaa6-0d0067a60d4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:37.801494 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-7b702ac2-2239-4c5f-aaa6-0d0067a60d4b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457188 Aug 10 22:40:37.802023 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 7/14] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:37.819137 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-1b80766e-8fa9-4c1f-a025-01a9eef09ed2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:37.850200 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-1b80766e-8fa9-4c1f-a025-01a9eef09ed2 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035429 Aug 10 22:40:37.850783 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 8/15] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 10 22:40:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:40.060489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-7b702ac2-2239-4c5f-aaa6-0d0067a60d4b admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:40.061587 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-7b702ac2-2239-4c5f-aaa6-0d0067a60d4b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 10 22:40:40.061977 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 8/16] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:40.515424 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-24a512ad-9ad5-4285-bebf-1422ac3a60ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:40.538201 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-24a512ad-9ad5-4285-bebf-1422ac3a60ee admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469306 Aug 10 22:40:40.539528 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 9/17] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:40.552261 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-e346f5f8-cb3a-40e3-9d3f-34dde8fc66f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:40.581637 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-e346f5f8-cb3a-40e3-9d3f-34dde8fc66f5 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033596 Aug 10 22:40:40.582658 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 9/18] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 10 22:40:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:40:42.827355 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-24a512ad-9ad5-4285-bebf-1422ac3a60ee admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:42.828343 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-24a512ad-9ad5-4285-bebf-1422ac3a60ee admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 10 22:40:42.828742 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 10/19] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:40:43.339954 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-7b6cacc8-5526-4409-b007-4f30899b0c79 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:43.374355 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-7b6cacc8-5526-4409-b007-4f30899b0c79 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.539063 Aug 10 22:40:43.375125 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 10/20] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 10 22:40:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:40:46.147138 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-24a512ad-9ad5-4285-bebf-1422ac3a60ee admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:46.148149 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-24a512ad-9ad5-4285-bebf-1422ac3a60ee admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 10 22:40:46.148578 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 11/21] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:40:46.588961 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-3c10ac07-245d-4f01-b30c-6061aad64b54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:46.608577 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-3c10ac07-245d-4f01-b30c-6061aad64b54 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.452517 Aug 10 22:40:46.609128 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 11/22] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:46.623701 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-002d2dff-15ab-47dc-9c3d-73b386411a8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:46.650834 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-002d2dff-15ab-47dc-9c3d-73b386411a8c admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030691 Aug 10 22:40:46.651561 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 12/23] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 10 22:40:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:49.099475 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-3c10ac07-245d-4f01-b30c-6061aad64b54 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:49.100490 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-3c10ac07-245d-4f01-b30c-6061aad64b54 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 10 22:40:49.100894 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 12/24] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:49.512492 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-31cc1210-36f9-43da-bca6-56b8362e6718 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:49.532254 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-31cc1210-36f9-43da-bca6-56b8362e6718 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424573 Aug 10 22:40:49.532935 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 13/25] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:49.545097 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-15a3e33c-3252-4c32-84d4-91e09f8f38d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:49.571084 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-15a3e33c-3252-4c32-84d4-91e09f8f38d4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029845 Aug 10 22:40:49.571651 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 13/26] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 10 22:40:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:51.951664 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-31cc1210-36f9-43da-bca6-56b8362e6718 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:51.952642 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-31cc1210-36f9-43da-bca6-56b8362e6718 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 10 22:40:51.953099 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 14/27] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:52.319073 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-68031044-8275-46a6-8016-5707e20bf233 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "disk": 40, "id": "3"}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:52.339205 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-68031044-8275-46a6-8016-5707e20bf233 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.380026 Aug 10 22:40:52.339759 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 14/28] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:40:52.356234 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-7bf8d386-c03d-4987-b476-e6f1a7435b53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:52.386926 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-7bf8d386-c03d-4987-b476-e6f1a7435b53 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032437 Aug 10 22:40:52.386926 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 15/29] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 10 22:40:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:54.650381 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-68031044-8275-46a6-8016-5707e20bf233 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:54.651451 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-68031044-8275-46a6-8016-5707e20bf233 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 10 22:40:54.651847 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 15/30] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:55.105066 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-c6a0de76-3b41-4a87-9049-b0b2dfe3895c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "disk": 80, "swap": 0, "vcpus": 4, "ram": 8192, "name": "m1.large"}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:55.129507 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-c6a0de76-3b41-4a87-9049-b0b2dfe3895c admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471191 Aug 10 22:40:55.130416 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 16/31] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:55.143061 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-731ae7e9-14e8-4eaf-aa37-504eb4c9dc84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:55.170379 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-731ae7e9-14e8-4eaf-aa37-504eb4c9dc84 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031028 Aug 10 22:40:55.170988 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 16/32] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 10 22:40:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:40:57.455485 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-c6a0de76-3b41-4a87-9049-b0b2dfe3895c admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:40:57.457145 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-c6a0de76-3b41-4a87-9049-b0b2dfe3895c admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Aug 10 22:40:57.458435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 17/33] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:40:57.933651 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-b111f648-4ead-4bf2-9963-9f7d1263c2ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:57.954401 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-b111f648-4ead-4bf2-9963-9f7d1263c2ea admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.488017 Aug 10 22:40:57.963099 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 17/34] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 10 22:40:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:40:57.968392 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-0eda9911-d430-402d-8bbf-591480c3affa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:40:57.973707 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:57.999965 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-0eda9911-d430-402d-8bbf-591480c3affa admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035794 Aug 10 22:40:58.000655 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 18/35] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 10 22:40:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:41:17.782623 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-b111f648-4ead-4bf2-9963-9f7d1263c2ea admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:17.783616 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-b111f648-4ead-4bf2-9963-9f7d1263c2ea admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 10 22:41:17.784009 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 18/36] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:17.794795 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:18.181489 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-182a7e14-168e-4096-a8ff-c08514e12628 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:18.200457 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-182a7e14-168e-4096-a8ff-c08514e12628 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410501 Aug 10 22:41:18.200994 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 19/37] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 10 22:41:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:41:19.268749 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-b111f648-4ead-4bf2-9963-9f7d1263c2ea admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:19.269874 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-b111f648-4ead-4bf2-9963-9f7d1263c2ea admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 10 22:41:19.270747 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 19/38] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:19.928003 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-bd4a49b7-5f28-44bf-a8c7-044a7315c1e5 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:19.933748 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.wsgi [None req-bd4a49b7-5f28-44bf-a8c7-044a7315c1e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-bd4a49b7-5f28-44bf-a8c7-044a7315c1e5 admin admin] Request method failure captured: Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Accept: application/json Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Accept-Encoding: gzip, deflate Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Connection: keep-alive Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Content-Length: 0 Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Host: 10.222.0.76 Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Openstack-Api-Version: compute 2.90 Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Openstack-System-Scope: None Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: User-Agent: python-novaclient Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Auth-Token: gAAAAABi9DQP4Z8Fi5RzHJiJJky9NDaUCtPUfhOpYREzl9eP0XVlASGnBAZJU97uCW_0eQgtcV8pQ_3l6YqoCjb_OcK2CcmNXpWQqRXoQhNoHrRpasMouN1QwL3vPHQdp59xffKvLeb4O3b40_k_G_s5VZxN6t8d8QDMwnXmjkY0tCZopIpWMbA Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Domain-Id: None Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Domain-Name: None Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Identity-Status: Confirmed Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Is-Admin-Project: True Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Domain-Id: default Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Domain-Name: Default Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Name: admin Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Role: member,reader,admin Aug 10 22:41:19.936967 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Roles: member,reader,admin Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}] Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant: admin Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant-Name: admin Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User: admin Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Domain-Id: default Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Domain-Name: Default Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Id: d91ed101f8354003baf64fb2ad037357 Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Name: admin Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: method: > Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: exception: Flavor 42 could not be found. Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: action_args: {'id': '42'} Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:41:19.938524 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:19.939397 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:19.940811 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-bd4a49b7-5f28-44bf-a8c7-044a7315c1e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:41:19.942222 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-bd4a49b7-5f28-44bf-a8c7-044a7315c1e5 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.527717 Aug 10 22:41:19.942222 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 20/39] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 10 22:41:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 529 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:41:19.948406 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-182a5058-beb1-4de5-88c9-fc4865b4f702 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:19.952494 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.973614 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-182a5058-beb1-4de5-88c9-fc4865b4f702 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029003 Aug 10 22:41:19.974183 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 20/40] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 10 22:41:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:41:19.985262 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-0486d579-741b-48a9-9aa3-48b56dc9a818 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:20.015581 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-0486d579-741b-48a9-9aa3-48b56dc9a818 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034257 Aug 10 22:41:20.016146 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 21/41] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 10 22:41:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:41:20.026310 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-c56bdf14-4ed3-4a8a-b58c-dcb9ae6a3dd4 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:20.033100 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.wsgi [None req-c56bdf14-4ed3-4a8a-b58c-dcb9ae6a3dd4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-c56bdf14-4ed3-4a8a-b58c-dcb9ae6a3dd4 admin admin] Request method failure captured: Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Accept: application/json Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Accept-Encoding: gzip, deflate Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Connection: keep-alive Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Content-Length: 0 Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Host: 10.222.0.76 Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Openstack-Api-Version: compute 2.90 Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Openstack-System-Scope: None Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: User-Agent: python-novaclient Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Auth-Token: gAAAAABi9DQP4Z8Fi5RzHJiJJky9NDaUCtPUfhOpYREzl9eP0XVlASGnBAZJU97uCW_0eQgtcV8pQ_3l6YqoCjb_OcK2CcmNXpWQqRXoQhNoHrRpasMouN1QwL3vPHQdp59xffKvLeb4O3b40_k_G_s5VZxN6t8d8QDMwnXmjkY0tCZopIpWMbA Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Domain-Id: None Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Domain-Name: None Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Identity-Status: Confirmed Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Is-Admin-Project: True Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Domain-Id: default Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Domain-Name: Default Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Name: admin Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Role: member,reader,admin Aug 10 22:41:20.036426 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Roles: member,reader,admin Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}] Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant: admin Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant-Name: admin Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User: admin Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Domain-Id: default Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Domain-Name: Default Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Id: d91ed101f8354003baf64fb2ad037357 Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Name: admin Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: method: > Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: exception: Flavor 42 could not be found. Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: action_args: {'id': '42'} Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:41:20.038014 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:20.038970 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:20.040489 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-c56bdf14-4ed3-4a8a-b58c-dcb9ae6a3dd4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:41:20.042705 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-c56bdf14-4ed3-4a8a-b58c-dcb9ae6a3dd4 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015675 Aug 10 22:41:20.042705 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 21/42] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 10 22:41:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:41:20.995966 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-0486d579-741b-48a9-9aa3-48b56dc9a818 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:20.997009 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-0486d579-741b-48a9-9aa3-48b56dc9a818 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 10 22:41:20.997435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 22/43] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:21.546017 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-30077203-2dd4-4dac-913a-c8a8443a5e43 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:21.551261 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.wsgi [None req-30077203-2dd4-4dac-913a-c8a8443a5e43 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-30077203-2dd4-4dac-913a-c8a8443a5e43 admin admin] Request method failure captured: Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Accept: application/json Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Accept-Encoding: gzip, deflate Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Connection: keep-alive Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Content-Length: 0 Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Host: 10.222.0.76 Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Openstack-Api-Version: compute 2.90 Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Openstack-System-Scope: None Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: User-Agent: python-novaclient Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Auth-Token: gAAAAABi9DQQShmVMKaMO1L_QqlEUOa-CMWDJRNa9BXVAlzUGbvlVptN37JS-sBKSHSfhfMBdSFQAjjmR027VKYyYg-4Dz_5k_oFOWSLRitGxPifruRKdSx8EDkD6RtaTMqAF_NZNywL5tIXQGqWFNsfnoTXKkztSvK6dvpvn58CJJcctZVG-p4 Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Domain-Id: None Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Domain-Name: None Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Identity-Status: Confirmed Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Is-Admin-Project: True Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Domain-Id: default Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Domain-Name: Default Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Name: admin Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Role: member,reader,admin Aug 10 22:41:21.552735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Roles: member,reader,admin Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}] Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant: admin Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant-Name: admin Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User: admin Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Domain-Id: default Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Domain-Name: Default Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Id: d91ed101f8354003baf64fb2ad037357 Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Name: admin Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: method: > Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: exception: Flavor 84 could not be found. Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: action_args: {'id': '84'} Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:41:21.554302 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:21.555148 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.556252 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-30077203-2dd4-4dac-913a-c8a8443a5e43 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:41:21.557694 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-30077203-2dd4-4dac-913a-c8a8443a5e43 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.411269 Aug 10 22:41:21.557694 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 22/44] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 10 22:41:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:41:21.564057 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-c80c9eb2-e1fa-49d9-a51c-69fef2fc35f3 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:21.579019 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-c80c9eb2-e1fa-49d9-a51c-69fef2fc35f3 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018550 Aug 10 22:41:21.579541 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 23/45] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 10 22:41:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:41:21.589735 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-da31f876-88ae-43d7-a489-3db6ae39ef65 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:21.605386 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-da31f876-88ae-43d7-a489-3db6ae39ef65 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020090 Aug 10 22:41:21.605922 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 23/46] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 10 22:41:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:41:21.615122 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-fe71c094-7195-4437-994b-005f34693549 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:21.621378 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.wsgi [None req-fe71c094-7195-4437-994b-005f34693549 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-fe71c094-7195-4437-994b-005f34693549 admin admin] Request method failure captured: Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Accept: application/json Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Accept-Encoding: gzip, deflate Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Connection: keep-alive Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Content-Length: 0 Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Host: 10.222.0.76 Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Openstack-Api-Version: compute 2.90 Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Openstack-System-Scope: None Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: User-Agent: python-novaclient Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Auth-Token: gAAAAABi9DQQShmVMKaMO1L_QqlEUOa-CMWDJRNa9BXVAlzUGbvlVptN37JS-sBKSHSfhfMBdSFQAjjmR027VKYyYg-4Dz_5k_oFOWSLRitGxPifruRKdSx8EDkD6RtaTMqAF_NZNywL5tIXQGqWFNsfnoTXKkztSvK6dvpvn58CJJcctZVG-p4 Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Domain-Id: None Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Domain-Name: None Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Identity-Status: Confirmed Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Is-Admin-Project: True Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Domain-Id: default Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Domain-Name: Default Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Name: admin Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Role: member,reader,admin Aug 10 22:41:21.622863 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Roles: member,reader,admin Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}] Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant: admin Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant-Name: admin Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User: admin Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Domain-Id: default Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Domain-Name: Default Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Id: d91ed101f8354003baf64fb2ad037357 Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Name: admin Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: method: > Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: exception: Flavor 84 could not be found. Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: action_args: {'id': '84'} Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:41:21.624375 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:21.625435 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:21.626529 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-fe71c094-7195-4437-994b-005f34693549 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:41:21.627528 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-fe71c094-7195-4437-994b-005f34693549 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012592 Aug 10 22:41:21.627528 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 24/47] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 10 22:41:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 22:41:22.595887 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-da31f876-88ae-43d7-a489-3db6ae39ef65 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:22.596879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-da31f876-88ae-43d7-a489-3db6ae39ef65 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 10 22:41:22.597292 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 24/48] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:23.125034 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-f57896b6-babc-4d4f-b4c7-67002971d9f8 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:23.130772 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.wsgi [None req-f57896b6-babc-4d4f-b4c7-67002971d9f8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-f57896b6-babc-4d4f-b4c7-67002971d9f8 admin admin] Request method failure captured: Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Accept: application/json Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Accept-Encoding: gzip, deflate Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Connection: keep-alive Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Content-Length: 0 Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Host: 10.222.0.76 Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Openstack-Api-Version: compute 2.90 Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Openstack-System-Scope: None Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: User-Agent: python-novaclient Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Auth-Token: gAAAAABi9DQSpb1SrKcG1yQNwLJycnFfkxsgGpZK7ctGt7Ku_paZSr59v8MpY_kaq6ZDQYwlvKUw9ZC0baZqkSPXMVDZYFv72cqWxdz3MjuFGY41vw6gUjK7pyN7daYHMqRULpxt1NSWvfx9yO1II3Ghud3Ys3GQkhPjA6wnPtiQN0jnSmonubI Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Domain-Id: None Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Domain-Name: None Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Identity-Status: Confirmed Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Is-Admin-Project: True Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Domain-Id: default Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Domain-Name: Default Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Project-Name: admin Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Role: member,reader,admin Aug 10 22:41:23.132258 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Roles: member,reader,admin Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}] Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant: admin Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-Tenant-Name: admin Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User: admin Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Domain-Id: default Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Domain-Name: Default Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Id: d91ed101f8354003baf64fb2ad037357 Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: X-User-Name: admin Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: method: > Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: exception: Flavor 451 could not be found. Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: action_args: {'id': '451'} Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:41:23.133920 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:23.135376 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.136531 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-f57896b6-babc-4d4f-b4c7-67002971d9f8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:41:23.137609 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-f57896b6-babc-4d4f-b4c7-67002971d9f8 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396368 Aug 10 22:41:23.137609 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 25/49] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 10 22:41:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:41:23.143772 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-b3da5135-cfc1-4579-a7f5-25289cd49fa5 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:23.159028 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-b3da5135-cfc1-4579-a7f5-25289cd49fa5 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018820 Aug 10 22:41:23.159546 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 25/50] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 10 22:41:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:41:23.169453 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:23.183990 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018405 Aug 10 22:41:23.184508 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 26/51] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 10 22:41:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:41:23.193867 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-618dd29b-e70c-4032-9f84-e0f3cd16294e admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:23.199718 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.wsgi [None req-618dd29b-e70c-4032-9f84-e0f3cd16294e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-618dd29b-e70c-4032-9f84-e0f3cd16294e admin admin] Request method failure captured: Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Accept: application/json Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Accept-Encoding: gzip, deflate Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Connection: keep-alive Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Content-Length: 0 Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Host: 10.222.0.76 Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Openstack-Api-Version: compute 2.90 Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Openstack-System-Scope: None Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: User-Agent: python-novaclient Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Auth-Token: gAAAAABi9DQSpb1SrKcG1yQNwLJycnFfkxsgGpZK7ctGt7Ku_paZSr59v8MpY_kaq6ZDQYwlvKUw9ZC0baZqkSPXMVDZYFv72cqWxdz3MjuFGY41vw6gUjK7pyN7daYHMqRULpxt1NSWvfx9yO1II3Ghud3Ys3GQkhPjA6wnPtiQN0jnSmonubI Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Domain-Id: None Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Domain-Name: None Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Identity-Status: Confirmed Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Is-Admin-Project: True Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Domain-Id: default Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Domain-Name: Default Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Project-Name: admin Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Role: member,reader,admin Aug 10 22:41:23.201196 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Roles: member,reader,admin Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_946936eb2d5946a8b7f7ecfc0535ae77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/946936eb2d5946a8b7f7ecfc0535ae77"}]}] Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant: admin Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant-Id: 946936eb2d5946a8b7f7ecfc0535ae77 Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-Tenant-Name: admin Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User: admin Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Domain-Id: default Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Domain-Name: Default Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Id: d91ed101f8354003baf64fb2ad037357 Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: X-User-Name: admin Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: method: > Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: exception: Flavor 451 could not be found. Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: action_args: {'id': '451'} Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:41:23.202879 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:23.203931 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: ERROR nova.api.openstack.wsgi Aug 10 22:41:23.205264 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-618dd29b-e70c-4032-9f84-e0f3cd16294e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:41:23.206556 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-618dd29b-e70c-4032-9f84-e0f3cd16294e admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012282 Aug 10 22:41:23.206556 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 26/52] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 10 22:41:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:41:24.178313 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:24.179317 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 10 22:41:24.179713 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 27/53] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:24.705827 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-6ea54d83-45ab-4d31-9722-371ee97065f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:41:24.725431 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-6ea54d83-45ab-4d31-9722-371ee97065f9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408694 Aug 10 22:41:24.725989 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 27/54] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 10 22:41:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:41:25.718284 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:25.719280 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 10 22:41:25.719667 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 28/55] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:41:26.244186 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-e8385c38-db7b-4da1-abd6-8a95d4e8c58a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:41:26.262598 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-e8385c38-db7b-4da1-abd6-8a95d4e8c58a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403670 Aug 10 22:41:26.263189 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 28/56] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 10 22:41:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:41:27.230084 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:27.231927 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002522 Aug 10 22:41:27.232618 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 29/57] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:27.759804 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-801d32e9-7e62-49da-bf43-8fb4f66682aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:41:27.778763 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-801d32e9-7e62-49da-bf43-8fb4f66682aa admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406300 Aug 10 22:41:27.779318 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 29/58] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 10 22:41:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:41:28.763506 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:28.764547 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 10 22:41:28.764939 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 30/59] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:29.301852 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-cd552bc4-439a-4719-8670-ef75602876f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:41:29.320167 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-cd552bc4-439a-4719-8670-ef75602876f6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.415716 Aug 10 22:41:29.321155 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 30/60] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 10 22:41:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:41:30.293681 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:30.294680 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 10 22:41:30.295078 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 31/61] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:41:30.845145 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-b9ad3f95-5b10-4f4a-9385-1dba3d9316ca admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:41:30.865461 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-b9ad3f95-5b10-4f4a-9385-1dba3d9316ca admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.424908 Aug 10 22:41:30.865996 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 31/62] 10.222.0.76 () {60 vars in 1202 bytes} [Wed Aug 10 22:41:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:42:22.763323 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:42:22.764316 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-a24b908e-a0e3-4f10-a66f-52f4ee3511c7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 10 22:42:22.765543 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 32/63] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 10 22:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:42:22.775873 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.165745 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-e1637b5d-7848-4d92-9edb-f83ccd69a980 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:42:23.185974 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-e1637b5d-7848-4d92-9edb-f83ccd69a980 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414580 Aug 10 22:42:23.186516 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 32/64] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 10 22:42:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:42:23.208615 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG dbcounter [-] [117456] Writing DB stats nova_api:SELECT=14 {{(pid=117456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.212392 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-f9abfe98-7ee1-47a1-9b8e-384e3fa27758 admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:42:23.220021 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-f9abfe98-7ee1-47a1-9b8e-384e3fa27758 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012792 Aug 10 22:42:23.220543 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 33/65] 10.222.0.76 () {60 vars in 1283 bytes} [Wed Aug 10 22:42:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:42:23.232018 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-50498670-d3e8-4819-81de-64ea10c5a107 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:42:23.239831 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-50498670-d3e8-4819-81de-64ea10c5a107 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011447 Aug 10 22:42:23.240340 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 33/66] 10.222.0.76 () {60 vars in 1286 bytes} [Wed Aug 10 22:42:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:42:23.252175 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:42:23.259588 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011426 Aug 10 22:42:23.260090 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 34/67] 10.222.0.76 () {60 vars in 1286 bytes} [Wed Aug 10 22:42:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:42:23.271923 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-e5d27de1-8bb9-4acd-abbd-00a8b8b3a186 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:42:23.279581 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-e5d27de1-8bb9-4acd-abbd-00a8b8b3a186 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010908 Aug 10 22:42:23.280095 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 34/68] 10.222.0.76 () {60 vars in 1283 bytes} [Wed Aug 10 22:42:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:45:27.097718 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:27.098709 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 10 22:45:27.099104 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 35/69] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:45:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:45:27.243066 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_api:SELECT=6 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:27.405082 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:27.407501 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:45:27.407501 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: warnings.warn(msg) Aug 10 22:45:27.408619 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:27.409094 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:27.409545 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:27.410254 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:27.410731 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:27.411149 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:27.447342 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-aacb906b-7431-4990-aecc-aed76cc522a0 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.205796 Aug 10 22:45:27.447917 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 35/70] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 10 22:45:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:45:28.289134 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:28.290212 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 10 22:45:28.290603 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 36/71] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:45:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:45:28.487383 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:28.490807 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:45:28.490807 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: warnings.warn(msg) Aug 10 22:45:28.492054 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:28.492583 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:28.493001 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:28.493859 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:28.494304 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:28.494709 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:28.514139 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-2f26ec9b-3cf5-4d62-a1c7-d434226a2dbe admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080184 Aug 10 22:45:28.514705 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 36/72] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 10 22:45:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:45:39.761374 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:39.762366 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 10 22:45:39.762758 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 37/73] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:45:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:45:39.904115 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_cell0:SELECT=4 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:39.904834 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_cell1:SELECT=4 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:39.905596 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG dbcounter [-] [117457] Writing DB stats nova_api:SELECT=8 {{(pid=117457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:39.956009 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:39.958382 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:45:39.958382 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: warnings.warn(msg) Aug 10 22:45:39.959599 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:39.960206 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:39.960626 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:39.961351 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:39.961791 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:39.962199 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:39.986407 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-6a7442b4-cc64-4837-a2d6-325896631acf admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086719 Aug 10 22:45:39.986885 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 37/74] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 10 22:45:39 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:45:40.833583 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: DEBUG nova.api.openstack.wsgi [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] Calling method '>' {{(pid=117456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:40.834770 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: INFO nova.api.openstack.requestlog [None req-1fb413a5-5d69-4099-8f73-c2e7810b547f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 10 22:45:40.835193 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: [pid: 117456|app: 0|req: 38/75] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 10 22:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:45:41.024982 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG nova.api.openstack.wsgi [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] Calling method '>' {{(pid=117457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:41.027406 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:45:41.027406 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: warnings.warn(msg) Aug 10 22:45:41.028517 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:41.028986 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:41.029438 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:41.030142 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:41.030582 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:41.030990 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: DEBUG oslo_concurrency.lockutils [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:41.053536 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: INFO nova.api.openstack.requestlog [None req-5a6a0cb8-8afc-42a0-8014-8e92bb4ceccd admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080287 Aug 10 22:45:41.054073 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: [pid: 117457|app: 0|req: 38/76] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 10 22:45:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:46:37.992260 dv-cinder-836083-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 22:46:37.993119 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: Wed Aug 10 22:46:37 2022 - graceful shutdown triggered... Aug 10 22:46:37.993658 dv-cinder-836083-12-iscsi devstack@n-api.service[117456]: Gracefully killing worker 1 (pid: 117456)... Aug 10 22:46:37.994091 dv-cinder-836083-12-iscsi devstack@n-api.service[117457]: Gracefully killing worker 2 (pid: 117457)... Aug 10 22:46:38.994284 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: worker 1 buried after 1 seconds Aug 10 22:46:38.994839 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: worker 2 buried after 1 seconds Aug 10 22:46:38.994839 dv-cinder-836083-12-iscsi devstack@n-api.service[117455]: goodbye to uWSGI. Aug 10 22:46:38.995848 dv-cinder-836083-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 22:46:38.996393 dv-cinder-836083-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 22:46:38.999223 dv-cinder-836083-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 22:46:39.008720 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 22:46:39 2022] *** Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: nodename: dv-cinder-836083-12-iscsi Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: machine: x86_64 Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: clock source: unix Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: pcre jit disabled Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: detected number of CPU cores: 4 Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: current working directory: / Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: detected binary path: /usr/bin/uwsgi-core Aug 10 22:46:39.010775 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: your processes number limit is 47680 Aug 10 22:46:39.011483 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: your memory page size is 4096 bytes Aug 10 22:46:39.011483 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: detected max file descriptor number: 2048 Aug 10 22:46:39.011483 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: lock engine: pthread robust mutexes Aug 10 22:46:39.011483 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: thunder lock: enabled Aug 10 22:46:39.011483 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 22:46:39.011483 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 22:46:39.063179 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: Python main interpreter initialized at 0x5654acf519c0 Aug 10 22:46:39.063179 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: python threads support enabled Aug 10 22:46:39.063179 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: your server socket listen backlog is limited to 100 connections Aug 10 22:46:39.063179 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: your mercy for graceful operations on workers is 90 seconds Aug 10 22:46:39.063608 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 22:46:39.063608 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: *** Operational MODE: preforking *** Aug 10 22:46:39.065243 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: *** uWSGI is running in multiple interpreter mode *** Aug 10 22:46:39.065243 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: spawned uWSGI master process (pid: 132518) Aug 10 22:46:39.065243 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: spawned uWSGI worker 1 (pid: 132540, cores: 1) Aug 10 22:46:39.064127 dv-cinder-836083-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 22:46:39.073334 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: spawned uWSGI worker 2 (pid: 132541, cores: 1) Aug 10 22:46:39.073334 dv-cinder-836083-12-iscsi devstack@n-api.service[132518]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 22:46:39.739963 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:46:39.755714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:46:40.895294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:46:40.895294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: from cryptography.utils import int_from_bytes Aug 10 22:46:40.895914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:46:40.895914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: from cryptography.utils import int_from_bytes Aug 10 22:46:40.947672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:46:40.947672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: from cryptography.utils import int_from_bytes Aug 10 22:46:40.948316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:46:40.948316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: from cryptography.utils import int_from_bytes Aug 10 22:46:43.253042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:46:43.253610 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:46:43.253838 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:46:43.254200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:46:43.254458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:46:43.254843 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.255170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.255492 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.255809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.256141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.256450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.256771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.257221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.257728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.257959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.258372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.258596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-12-iscsi {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.258917 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.259418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.259891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.260380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.260847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.261340 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.261809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.262586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.264046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.264046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.264046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.264046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.264383 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.264465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.264734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.265037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.265406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.265710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.266119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-12-iscsi {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.266431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.266746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.267079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.267480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.267795 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.268126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.268446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.268765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.269072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.269427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.269750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.270069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.270386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.270688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.270998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.271308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.271623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.271930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.272234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.272477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.273500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.273946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.274275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.274601 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.274857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.275112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.275434 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.275754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.276070 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.276376 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.276684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.276992 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.277313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.277625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.277931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.278238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.278552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.278865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.279186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.279491 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.279812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.280210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.280458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.280764 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.281103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.281442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.281751 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.282070 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.282390 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.282701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.283004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.283309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.283628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.283958 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.284260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.284512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.284813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.285118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.285470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.285777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.286092 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.286400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.286702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.287010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.287914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.287914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.287914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.289190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.289190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.289521 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.289751 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.290074 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.290382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.290702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.291010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.291316 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.291623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.291969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.292248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.292553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.292857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.293176 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.293509 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.293801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.294117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.294425 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.294730 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.295045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.295345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.295648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.295970 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.296277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.296580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.296878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.297182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.297531 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.297837 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.298139 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.298441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.298915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.299071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.299343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.299651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.299956 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.300263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.300581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.300916 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.301247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.301632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.301946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.302278 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.302609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.303319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.303484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.303787 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.304163 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.304480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.304797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.305104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.305599 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.305777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.306073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.306386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.306707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.307026 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.307338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.307654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.307983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.308306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.308615 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.308955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.309369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.309642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.309969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.310294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.310609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.310920 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.311371 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.311533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.311869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.312181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.312501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.312813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.313126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.313462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.313771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.314083 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.314422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.314755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.315046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.315358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.315676 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.315994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.316307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.316617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.316921 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.317253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.317564 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.317876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.318180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.318506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.318827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.319132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.319466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.319987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.320363 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.320734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.320993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.321335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.321639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.321951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.322256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.322580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.322891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.323196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.323524 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.323827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.324131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.324447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.324883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.325045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.325390 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.325707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.326035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.326352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.326720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.327032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.327318 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.327617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.327940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.328266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.328586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.328888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.329197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.329525 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.329831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.330163 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.330482 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.330771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.331071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.331374 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.331675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.331976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.332298 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.332604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.332907 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.333210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.333613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.333883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.334188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.334540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.334993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.335753 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.336333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.336922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.337302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.337778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.338259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.338757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.339077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.339404 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.339721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.340044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.340359 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.340689 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.341003 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.341344 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.341654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.341972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.342313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.342649 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.342968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.343291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.343604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.343923 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.344234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.344544 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.344856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.345187 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.345505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.345819 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.346147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.346458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.346783 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.347095 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.347415 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.347719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.348031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.348361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.348694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.349002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.349332 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.349656 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.349967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.350278 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.350589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.351508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.351824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.352136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.352643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.352959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.353271 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.353616 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.353935 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.354243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.354547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.354856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.355344 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.355516 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.355788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.356108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.356432 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.356736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.357040 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.357405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.358026 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.358341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.358647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.359125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.359328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.359645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.359949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.360267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.360588 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.360896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.361213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.361565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.361875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.362197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.362512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.362819 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.363131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.363443 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.363752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.364063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.364381 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.364688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.364997 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.365392 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.365650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.365934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.366257 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.367065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.367428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.367762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.368030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.368353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.368673 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.369005 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.369356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.369742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.370006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.370320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.370627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.370932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.371244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.371549 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.371857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.372008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:46:43.372502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.372659 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:46:43.372804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.372804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.373076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:46:43.373227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.373415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:46:43.373563 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.373713 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:46:43.373888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.374078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.374932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.375278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.375470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.375808 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.375968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.376122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.376275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.376275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.376568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.376712 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.376862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.377013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.377171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.377347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.377534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.377789 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.378146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.378308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.378465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.378610 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.378761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.378912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.379056 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-12-iscsi {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.379225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.379471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.379471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.379786 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.379786 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.380201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.380357 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.380501 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.380644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.380796 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.380940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.381084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.381236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.381449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.381603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.381603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.381894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.382097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.382257 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.382410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.382556 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.382699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.382849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.383002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.383153 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.383305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.383447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.383608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.383752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.383908 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.384059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.384203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.384203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.384594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.384738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.384894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.385046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.385046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.385455 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.385609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.385962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-12-iscsi {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.386117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.386261 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.386412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.386555 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.386713 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.386857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.387007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.387007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.387279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.387429 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.387602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.387755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.388027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.388310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.388459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.388602 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.388757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.388909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.389061 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.389205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.389409 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.389708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.389877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.390043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.390278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.390441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.390585 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.390743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.390888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.391038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.391182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.391333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.391477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.391633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.391788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.391940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.391940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.392231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.392381 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.392540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.392540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.392828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.392973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.393126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.393298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.393463 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.393615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.393759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.393759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.394135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.394135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.394638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.394795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.394941 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.395093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.395236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.395389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.395625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.395789 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.396110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.396271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.396442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.396601 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.396752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.396909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.397067 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.397219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.397456 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.398166 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.398577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.398739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.398891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.399094 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.399263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.399434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.399586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.399840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.399998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.400158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.400398 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.400557 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.400715 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.400866 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.401023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.401023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.401339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.401339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.401643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.401794 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.401955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.402114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.402266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.402266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.402557 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.402708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.402708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.403001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.403152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.403307 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.403458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.403626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.403785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.403943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.404092 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.404250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.404406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.404566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.404819 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.404985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.405145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.405406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.405566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.405814 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.406738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.406909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.407018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.407107 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.407182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.407252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.407427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.407531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.407619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.407711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.407804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.407893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.407980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.408060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.408140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.408211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.408281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.408681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.408758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.408829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.408899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.408976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.409055 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.409210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.409394 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.409538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.409695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.409863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.409863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.410412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.410508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.410590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.410678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.410751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.410822 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.410901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.410981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.411053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.411136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.411208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.411286 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.411367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.411446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.411518 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.411589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.411657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.411735 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.411820 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.411893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.411970 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.412048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.412119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.412196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.412279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.412361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.412434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.412561 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.412644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.412873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.412969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.413179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.413353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.415972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.416346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.416533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.416533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.416836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.416987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.417150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.417418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.417592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.417753 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.417915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.418065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.418217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.418368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.418599 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.418952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.419113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.419265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.419423 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.419586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.419747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.419898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.420077 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.420243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.420515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.420769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.423059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.423241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.423403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.423578 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.423733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.423896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.424067 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.424219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.424382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.424533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.424692 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:46:43.424859 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.425442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.425617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.425770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.425920 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.425920 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.426611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.426786 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.426948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.427107 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.427265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.427428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.427590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.428010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.428168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.428318 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.428516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.428689 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.429641 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.429804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.429978 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.430130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.430292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.430443 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.430901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.431063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.431224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.431375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.431535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.431693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.431846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.431995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.432358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.432527 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.432689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.432841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.432992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.433142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.433142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.433476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.433638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.433789 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.433940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.434096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.434258 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.434428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.434579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.434728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.434888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.435039 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.435196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.435406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.435567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.435724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.435875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.436033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.436260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.436583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.436893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.436893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.437209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.437387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.437387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.437700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.437857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.438019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.438170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.438320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.438506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.438835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.439625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.440410 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.440586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.440841 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.441087 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.441257 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.441437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.441601 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.442778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.442957 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.443126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.443290 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.443450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.443617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.443777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.443939 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.444091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.444241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.444393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.444690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.445437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.445604 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.445765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.445916 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.446110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.446332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.446595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.447051 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.447221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.447382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.447542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.447542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.447863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.448014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.448172 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.448323 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.448480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.448640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.448856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.449014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.449173 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.449354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.449521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.449687 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.449848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.449999 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.450148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.450314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.450653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.450841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.451082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.451323 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.451481 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.451643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.451803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.451968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.452127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.452286 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.452438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.452595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.452747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.452907 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.453058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.453217 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.453445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.453606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.453759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.453922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.454073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.454303 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.454472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.454624 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.454855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.455009 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.455168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.455327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.455485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.455655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.455820 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.455972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.456130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.456281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.456438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.456596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.456757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.457194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.457386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.457542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.457711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.457882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.458048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.458201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.458357 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.458357 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.458651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.458811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.459012 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.459171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.459329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.459480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.459638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.459638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.459954 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.460107 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.460321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.460583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.461085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.461361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.461595 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.461754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.461905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.462055 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.462215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.462379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.462551 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.462709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.462860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.462860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.463168 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.464811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.464968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.465129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.465351 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.465524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.465691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.465844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.465995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.466157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.466317 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.466469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.466635 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.466787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.466944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.469323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.470117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.470293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.470452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.470728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.471364 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.471648 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.471961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.472136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.472328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.472505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.472668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.472820 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.472971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.472971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.473293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.473467 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.473643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.473797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.473956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.474109 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.474267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.474428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.474580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.474731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.474889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.475047 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.475208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.475367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.475543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.475703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.475888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.476040 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.476200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.476360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.476511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.476669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.476822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.476822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.477130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.477645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.477809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.477972 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478123 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.478441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.479787 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.479787 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.479787 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.479787 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.480382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.480533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.480533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.481497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.481771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.481771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.481771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.482378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.482378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.482378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.482812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.482812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.483129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.483279 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.483437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.483589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.483738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.483837 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.483925 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.484943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.485538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.485538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.485538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.485538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.485538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.485538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486014 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486202 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486552 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.486989 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487257 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487435 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487552 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.487820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488359 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488712 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.488990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489832 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489916 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.489999 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490814 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.490991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.491077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.491161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.491259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.491345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.492951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.493963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494131 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.494948 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495122 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.495928 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496544 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496853 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.496937 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497635 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.497744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498349 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.498993 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499181 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499504 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499590 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499688 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.499941 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500743 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.500926 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501185 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501379 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501577 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501653 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.501961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502506 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.502983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.503127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.503291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.503420 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.503595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.503736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.503897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.504046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.504196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.504395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.504497 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.504711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.504826 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.505055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.505165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.505389 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.505503 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.505692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.505797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.506044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.506359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.506691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.506794 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.507028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.507685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.508082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.508208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.508289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.508596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.508703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.508975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.509079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.509211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.509321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.509558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.509666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.509930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.510032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.510298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.510684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.510684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.510963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.511111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.511252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.511252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.511521 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.511668 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.511822 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.511962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.512101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.512190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.512359 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.512507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.512654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.512795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.512937 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.513890 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.514120 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.514215 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.514578 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.514673 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.514747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.514817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.515068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.515180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.515386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.515480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.515706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.515813 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.516018 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.516118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.516328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.516420 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.516636 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.516743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.516953 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.517045 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.517264 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.517362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.517594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.517693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.517905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.517988 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.518230 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.518327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.518523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.518608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519614 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.519873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.520080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.520182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.520399 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.520493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.520705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.520797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.521013 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.521105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.521356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.521468 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.521675 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.521768 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.521987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.522089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.522299 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.522391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.522610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.522779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.523101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.523269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.523422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.523699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.523810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.523966 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:46:43.524078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.524346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.524662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.524978 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.525311 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.525668 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.525980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.526349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.526664 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.526987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.527315 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.527639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.527958 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.528282 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.528598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.528922 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.529241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.529605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.530224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.530554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.530876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.531196 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.531522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.531851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.532183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.532493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.532810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.533128 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.533558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.533878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.534192 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.534509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.534831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.535150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.535471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.535788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.536101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.536419 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.536735 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.537047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.537408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.537729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.538038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.538454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.538971 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.539560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.539895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.540358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.540684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.541008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.541362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.541671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.541993 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.542319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.542653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.542966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.543400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.543725 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.544044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.544435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.544669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.544981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.545316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.545734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.546065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.546378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.546690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.547021 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.547336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.547665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.548106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.548428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.548739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.549167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.549515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.549836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.550170 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.550501 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.550833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.551299 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.551625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.551946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.552280 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.552612 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.553201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.553553 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.553865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.554731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.555301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.555815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.556153 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.556600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.556934 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.557256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.557613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.557949 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.558264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.558578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.558898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.559210 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.559527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.559865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.560179 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.560500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.560818 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.561134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.561571 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.561886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.562218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.562532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.562868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.563192 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.563524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.563853 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.564180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.564499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.564810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.565113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.565529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.565846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.566201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.566518 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.566851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.567192 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.567532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.567851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.568194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.568528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.568950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.569174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.569570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.570532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.571047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.571569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.571894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.572217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.572535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.572859 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.573177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.573516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.573837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.574176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.574490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.574823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.575145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.575570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.575766 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.576082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.576442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.576758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.577099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.577441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.577775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.578098 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.578421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.578745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.579072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.579393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.579724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.580044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.580360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.580686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.581010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.581359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.581947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.582286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.582608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.582930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.583251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.583572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.583893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.584216 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.584536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.584854 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.585259 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.585769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.586244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.586685 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.587090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.587374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.587702 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.588029 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.588354 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.588726 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.589052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.589396 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.589723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.590052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.590375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.590696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.591015 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.591337 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.591656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.591974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.592291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.592772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.593046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.593462 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.593814 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.594143 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.594464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.594786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.595111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.595697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.596020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.596358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.596689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.597020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.597372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.597699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.598035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.598349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.598661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.598977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.599295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.599613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.599941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.600258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.600572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.600928 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.601404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.602233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.602600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.602933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.603272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.603608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.603935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.604253 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.604587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.604901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.605216 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.605568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.605890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.606205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.606518 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.606841 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.607162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.607478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.607797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.608156 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.608928 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.608928 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.609159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.609502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.609828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.610142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.610456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.610769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.611083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.611403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.611715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.612033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.612344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.612663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.612974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.613320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.613622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.613957 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.614270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.614637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.614967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.615284 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.615616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.615934 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.616909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.617166 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.617745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.618480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.618829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.619162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.619515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.619860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.620177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.620494 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.620809 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.621144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.621488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.621810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.622127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.622446 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.622763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.623081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.623402 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.623784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.624374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.624488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.624746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.625063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.625405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.625724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.626046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.626400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.626724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.627046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.627367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.627690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.628007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.628322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.628637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.628952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.629273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.629628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.629955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.630271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.630702 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.631019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.631341 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.631670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.631985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.632557 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.633060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.633406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.633740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.634062 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.634400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.634746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.635082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.635416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.635733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.636043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.636354 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.636674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.636997 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.637331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.637645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.637954 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.638270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.638598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.638891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.639201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.639511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.639826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.640138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.640448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.640756 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.641066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.641410 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.641717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.642031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.642340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.642651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.642961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.643267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.643575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.643912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.644250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.644572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.644899 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.645214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.645569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.645885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.646215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.646544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.646869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.647183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.647521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.648306 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.648546 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.648903 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.649229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.649577 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.649906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.650245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.650583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.650901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.651236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.651564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.651893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.652216 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.652537 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.652874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.653194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.653536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.653855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.654173 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.654491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.654813 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.655131 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.655447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.655769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.656091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.656424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.656758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.657076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.657429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.657762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.658113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.658435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.658787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.659121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.659441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.659761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.660080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:46:43.660330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:46:43.673485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO dbcounter [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Registered counter for database nova_api Aug 10 22:46:43.695558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_db.sqlalchemy.engines [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:43.702645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writer thread running {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:43.769054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.context [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c55dad4d-2bd6-411b-a14d-21f8d7cc466a(cell1) {{(pid=132541) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:46:43.774058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:46:43.774651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:46:43.776247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:46:43.777166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:46:43.777942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:46:43.780044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:46:43.782082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO dbcounter [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Registered counter for database nova_cell0 Aug 10 22:46:43.786316 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO dbcounter [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Registered counter for database nova_cell1 Aug 10 22:46:43.794350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_db.sqlalchemy.engines [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:43.795889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_db.sqlalchemy.engines [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:43.802392 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writer thread running {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:43.807903 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writer thread running {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:43.824208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO dbcounter [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Registered counter for database nova_api Aug 10 22:46:43.844995 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_db.sqlalchemy.engines [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:43.851959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writer thread running {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:43.910110 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.context [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c55dad4d-2bd6-411b-a14d-21f8d7cc466a(cell1) {{(pid=132540) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:46:43.914481 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:46:43.914964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:46:43.916548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:46:43.917443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:46:43.918079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:46:43.920194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:46:43.922206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO dbcounter [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Registered counter for database nova_cell0 Aug 10 22:46:43.926296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO dbcounter [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Registered counter for database nova_cell1 Aug 10 22:46:43.935245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_db.sqlalchemy.engines [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:43.940482 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_db.sqlalchemy.engines [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:43.943118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writer thread running {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:43.948823 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO dbcounter [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Registered counter for database nova_cell0 Aug 10 22:46:43.955585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_db.sqlalchemy.engines [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:43.959980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writer thread running {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:44.084892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writer thread running {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:44.095789 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO dbcounter [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Registered counter for database nova_cell0 Aug 10 22:46:44.106746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_db.sqlalchemy.engines [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:46:44.111751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writer thread running {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:46:44.282760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: WARNING keystonemiddleware.auth_token [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:46:44.290767 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: WARNING keystonemiddleware.auth_token [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:46:44.436418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: WARNING keystonemiddleware.auth_token [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:46:44.444003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: WARNING keystonemiddleware.auth_token [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:46:44.651982 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: WARNING keystonemiddleware.auth_token [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:46:44.660935 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: WARNING keystonemiddleware.auth_token [None req-9c30429a-ec03-4d84-b86f-d9c6b25622cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:46:44.668553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5654acf519c0 pid: 132541 (default app) Aug 10 22:46:44.812973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: WARNING keystonemiddleware.auth_token [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:46:44.818973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: WARNING keystonemiddleware.auth_token [None req-1c05364c-b8f8-4ad5-93d4-b0e9c0f02a74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:46:44.825743 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5654acf519c0 pid: 132540 (default app) Aug 10 22:47:20.071235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:20.072674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:20.074014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:20.075226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:21.292799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d267d66b-1476-4e31-b2ab-a32d7ed9b210 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Action: 'create', calling method: .version_select at 0x7fa9c069ee50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1784485209"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:23.431116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d267d66b-1476-4e31-b2ab-a32d7ed9b210 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.394019 Aug 10 22:47:23.432093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1155 bytes} [Wed Aug 10 22:47:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 22:47:24.088864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7a3a622d-4b23-456a-a45f-dda1eea201a2 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0781940>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:24.151823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:24.152929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:24.154414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:24.155423 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:25.261750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7a3a622d-4b23-456a-a45f-dda1eea201a2 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962" status: 200 len: 346 microversion: 2.1 time: 1.817811 Aug 10 22:47:25.270620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 1/2] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:47:23 2022] GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 => generated 346 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:25.278571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5a617cbe-0184-45fa-b29a-8c3f205a621b tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Action: 'create', calling method: .version_select at 0x7fa9c0521c10>, body: {"snapshot": {"volume_id": "762e08c3-ba35-4781-a4a2-ea9fa783f962", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-515628434"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:25.741209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5a617cbe-0184-45fa-b29a-8c3f205a621b tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.469524 Aug 10 22:47:25.742319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 2/3] 10.222.0.76 () {60 vars in 1162 bytes} [Wed Aug 10 22:47:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:25.753103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-db3dc01f-791d-4988-9e5d-f1e29114f3d7 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c05d2ca0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:25.812837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-db3dc01f-791d-4988-9e5d-f1e29114f3d7 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.063650 Aug 10 22:47:25.814369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:25 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:25.829328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-01ac315f-a0d0-4daf-b17d-8529304bae71 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0535dc0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:25.934738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-01ac315f-a0d0-4daf-b17d-8529304bae71 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.111845 Aug 10 22:47:25.948294 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1828c468-76e3-46db-8138-fbcdaabd58ea tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c05d2c10>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:25.953757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 3/5] 10.222.0.76 () {58 vars in 1140 bytes} [Wed Aug 10 22:47:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:25.999452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1828c468-76e3-46db-8138-fbcdaabd58ea tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.055807 Aug 10 22:47:26.000018 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 3/6] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:25 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:27.013607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d5429dfc-ec1b-4dd4-bb4c-f2a286ad0b3a tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0535af0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:27.273869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d5429dfc-ec1b-4dd4-bb4c-f2a286ad0b3a tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.264395 Aug 10 22:47:27.274626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:27 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:28.287364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-911b631a-9e56-4dbe-918a-d8c1e418e8e6 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c05904c0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:28.378759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-911b631a-9e56-4dbe-918a-d8c1e418e8e6 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.095112 Aug 10 22:47:28.379619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:28 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:29.392697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1c49c762-349f-4370-be4f-33daf4657f42 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0535550>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:29.496114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1c49c762-349f-4370-be4f-33daf4657f42 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.107576 Aug 10 22:47:29.496531 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 5/9] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:29 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:30.510103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d65bfd2c-6c04-4449-be40-814575ba43cf tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0590b80>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:30.583908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d65bfd2c-6c04-4449-be40-814575ba43cf tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.079795 Aug 10 22:47:30.585792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 5/10] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:30 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:31.598013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-acdcab67-ad7a-4de4-a23f-f168500575c1 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0521ee0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:31.667190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-acdcab67-ad7a-4de4-a23f-f168500575c1 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.073562 Aug 10 22:47:31.667774 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 6/11] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:31 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:32.680111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-28a77d4b-1704-40bd-b95f-1f154517f1a0 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c05d2e50>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:32.739439 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-28a77d4b-1704-40bd-b95f-1f154517f1a0 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 287 microversion: 2.1 time: 0.063350 Aug 10 22:47:32.746316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:32 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:32.751630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-417f544b-de30-458b-958f-77c4a8111589 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c05908b0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:32.887209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-417f544b-de30-458b-958f-77c4a8111589 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 202 len: 0 microversion: 2.1 time: 0.139530 Aug 10 22:47:32.888099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1254 bytes} [Wed Aug 10 22:47:32 2022] DELETE /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:47:32.896766 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f73761a7-b3f5-41d0-9db7-8732f6543a84 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c05901f0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:32.954783 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f73761a7-b3f5-41d0-9db7-8732f6543a84 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 200 len: 286 microversion: 2.1 time: 0.062325 Aug 10 22:47:32.959097 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 8/14] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:32 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:33.254956 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-38d05fd5-316b-40bc-9f13-a34e797c0ff2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'create', calling method: .version_select at 0x7fa9c0521c10>, body: {"keypair": {"name": "tempest-keypair-32758888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkWTIlr4NK49RHt61hbZJoyiXWNMC8LdH2r8VpaMEshFy5Abkbzk+jO4ANqcVjWE9j4P7rYZ+LZTLeGnrQ8sq4ySCcnBr6hFo9/IuB7js5Er3XmZ7jSYwq7N8uyhvB3Q=="}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:33.358302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-38d05fd5-316b-40bc-9f13-a34e797c0ff2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for project a4e2567825f44d938dfbf7e043015367. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:47:33.373051 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-38d05fd5-316b-40bc-9f13-a34e797c0ff2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for user 12e6b0b71ecb4825aeab6735eb44e63e and project a4e2567825f44d938dfbf7e043015367. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:47:33.485446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-38d05fd5-316b-40bc-9f13-a34e797c0ff2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.757448 Aug 10 22:47:33.496915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 7/15] 10.222.0.76 () {62 vars in 1200 bytes} [Wed Aug 10 22:47:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 772 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 22:47:33.972313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f7d34beb-86de-4a21-91cd-4de4fd3c5b8c tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0590280>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:34.131075 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-f7d34beb-86de-4a21-91cd-4de4fd3c5b8c tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] HTTP exception thrown: Snapshot a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff could not be found. Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f7d34beb-86de-4a21-91cd-4de4fd3c5b8c tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Request method failure captured: Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff HTTP/1.1 Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DV37ZgEsHpu3AFQGPJCDAa9LE9AYW1x3W2c7YD6ZtKelENM1c7CUJ_JfIPkF9-ddGTwzWkBfXJ15sqi5YIvc4fyerp88gdtrSseKtuW_kBFNN1UWqzBaOGWdwBpuAs64hDQEZbAKM7fDpsO1ksHT845mYw6Bq460sbyIUfPqRRgSAU Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:47:34.139580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_dfa4e852819140a8ad723f54c756f607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}] Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 80a65ec30ace42ceb45e1a2d9d4c0b12 Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Snapshot a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff could not be found. Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff'} Aug 10 22:47:34.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff could not be found. (HTTP 404) (Request-ID: req-c70aaf6c-70d4-49d7-b508-e9bbfa115c7b) Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:34.142390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:47:34.143272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff could not be found. Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 22:47:34.144141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff could not be found. Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff could not be found. Aug 10 22:47:34.145101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:34.153590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f7d34beb-86de-4a21-91cd-4de4fd3c5b8c tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Returning 404 to user: Snapshot a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:34.153590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f7d34beb-86de-4a21-91cd-4de4fd3c5b8c tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff" status: 404 len: 111 microversion: 2.1 time: 0.184849 Aug 10 22:47:34.156004 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 9/16] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 10 22:47:33 2022] GET /compute/v2.1/os-snapshots/a12f8d25-3db1-4bf6-b7aa-45a2f67ab6ff => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:47:34.161469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-61184fd6-4358-430b-bf21-ac71cb81617e tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c050faf0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:34.363660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-61184fd6-4358-430b-bf21-ac71cb81617e tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962" status: 202 len: 0 microversion: 2.1 time: 0.206077 Aug 10 22:47:34.364243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 8/17] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:47:34 2022] DELETE /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:47:34.375963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bf4c9929-6198-4d0b-a57b-ba3606b85833 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c0eab310>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:34.478382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bf4c9929-6198-4d0b-a57b-ba3606b85833 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962" status: 200 len: 345 microversion: 2.1 time: 0.108099 Aug 10 22:47:34.479222 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 10/18] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:47:34 2022] GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:35.493846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-76574170-e86b-4764-8b5e-055f1bca7b44 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c04be790>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:35.599321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-76574170-e86b-4764-8b5e-055f1bca7b44 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] HTTP exception thrown: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-76574170-e86b-4764-8b5e-055f1bca7b44 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Request method failure captured: Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 HTTP/1.1 Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DV37ZgEsHpu3AFQGPJCDAa9LE9AYW1x3W2c7YD6ZtKelENM1c7CUJ_JfIPkF9-ddGTwzWkBfXJ15sqi5YIvc4fyerp88gdtrSseKtuW_kBFNN1UWqzBaOGWdwBpuAs64hDQEZbAKM7fDpsO1ksHT845mYw6Bq460sbyIUfPqRRgSAU Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:47:35.607207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_dfa4e852819140a8ad723f54c756f607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}] Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 80a65ec30ace42ceb45e1a2d9d4c0b12 Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '762e08c3-ba35-4781-a4a2-ea9fa783f962'} Aug 10 22:47:35.608324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. (HTTP 404) (Request-ID: req-a7a785f3-9671-4940-bca8-90b87bbba90d) Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.609099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:47:35.610017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 22:47:35.610904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.611772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-76574170-e86b-4764-8b5e-055f1bca7b44 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Returning 404 to user: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:35.614144 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-76574170-e86b-4764-8b5e-055f1bca7b44 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962" status: 404 len: 109 microversion: 2.1 time: 0.123868 Aug 10 22:47:35.621444 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 9/19] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:47:35 2022] GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:47:35.632738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fce1f4d2-1d15-4d54-b575-7cf3e8846cd6 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9c04e5670>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:35.704473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-fce1f4d2-1d15-4d54-b575-7cf3e8846cd6 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] HTTP exception thrown: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fce1f4d2-1d15-4d54-b575-7cf3e8846cd6 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Request method failure captured: Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 HTTP/1.1 Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DV37ZgEsHpu3AFQGPJCDAa9LE9AYW1x3W2c7YD6ZtKelENM1c7CUJ_JfIPkF9-ddGTwzWkBfXJ15sqi5YIvc4fyerp88gdtrSseKtuW_kBFNN1UWqzBaOGWdwBpuAs64hDQEZbAKM7fDpsO1ksHT845mYw6Bq460sbyIUfPqRRgSAU Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:47:35.708360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_dfa4e852819140a8ad723f54c756f607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}] Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 80a65ec30ace42ceb45e1a2d9d4c0b12 Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '762e08c3-ba35-4781-a4a2-ea9fa783f962'} Aug 10 22:47:35.709449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. (HTTP 404) (Request-ID: req-0732d7ca-d440-43c8-9b11-796a76a9a35e) Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.710086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 22:47:35.711060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 22:47:35.711964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.712825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.715970 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fce1f4d2-1d15-4d54-b575-7cf3e8846cd6 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Returning 404 to user: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:35.717392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fce1f4d2-1d15-4d54-b575-7cf3e8846cd6 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962" status: 404 len: 109 microversion: 2.1 time: 0.091390 Aug 10 22:47:35.718205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 11/20] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:47:35 2022] DELETE /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:47:35.741039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-86febb42-a0cf-4b2c-b64b-f40d85929f12 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Calling method '.version_select at 0x7fa9bfc2d550>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:35.789302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-86febb42-a0cf-4b2c-b64b-f40d85929f12 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] HTTP exception thrown: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-86febb42-a0cf-4b2c-b64b-f40d85929f12 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Request method failure captured: Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 HTTP/1.1 Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DV37ZgEsHpu3AFQGPJCDAa9LE9AYW1x3W2c7YD6ZtKelENM1c7CUJ_JfIPkF9-ddGTwzWkBfXJ15sqi5YIvc4fyerp88gdtrSseKtuW_kBFNN1UWqzBaOGWdwBpuAs64hDQEZbAKM7fDpsO1ksHT845mYw6Bq460sbyIUfPqRRgSAU Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:47:35.793750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_dfa4e852819140a8ad723f54c756f607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dfa4e852819140a8ad723f54c756f607"}]}] Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: dfa4e852819140a8ad723f54c756f607 Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1187892351 Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 80a65ec30ace42ceb45e1a2d9d4c0b12 Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1187892351-project Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '762e08c3-ba35-4781-a4a2-ea9fa783f962'} Aug 10 22:47:35.794814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. (HTTP 404) (Request-ID: req-fc99361d-323e-42b3-8225-34d5b008dcdf) Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.795595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:47:35.796501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 22:47:35.798424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. Aug 10 22:47:35.799307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:47:35.801078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-86febb42-a0cf-4b2c-b64b-f40d85929f12 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] Returning 404 to user: Volume 762e08c3-ba35-4781-a4a2-ea9fa783f962 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:35.802925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-86febb42-a0cf-4b2c-b64b-f40d85929f12 tempest-VolumesSnapshotsTestJSON-1187892351 tempest-VolumesSnapshotsTestJSON-1187892351-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962" status: 404 len: 109 microversion: 2.1 time: 0.078291 Aug 10 22:47:35.805102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 10/21] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:47:35 2022] GET /compute/v2.1/os-volumes/762e08c3-ba35-4781-a4a2-ea9fa783f962 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:47:38.564150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-856811469", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bd44dd4-585b-4b02-807c-85cd9220aa1f"}], "security_groups": [{"name": "tempest-securitygroup--385786860"}], "key_name": "tempest-keypair-32758888", "user_data": "}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:38.980248 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] validate_networks() for [('6bd44dd4-585b-4b02-807c-85cd9220aa1f', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:47:40.227802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1732838430", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "networks": [{"uuid": "2c71f40b-11dc-400a-bead-76c1a0a75f8c"}]}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:40.331157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] validate_networks() for [('2c71f40b-11dc-400a-bead-76c1a0a75f8c', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:47:41.568744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:47:41.570532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:47:41.571272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:47:41.571820 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:47:41.572366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:47:41.597498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:41.598200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:41.600187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:41.601219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:41.605154 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:41.605803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:41.667189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for project a4e2567825f44d938dfbf7e043015367. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:47:41.687279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for user 12e6b0b71ecb4825aeab6735eb44e63e and project a4e2567825f44d938dfbf7e043015367. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:47:41.711969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:47:41.715847 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:47:41.941025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3c189679-81fe-4b13-92ef-6078c37107e4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.381193 Aug 10 22:47:41.968381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 12/22] 10.222.0.76 () {62 vars in 1188 bytes} [Wed Aug 10 22:47:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 3389 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 22:47:42.083890 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:47:42.084431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:47:42.085386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:47:42.086615 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:47:42.087031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:47:42.120077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:42.120581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:42.121015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:42.121769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:42.122222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:42.122645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:42.190168 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Getting quotas for project aaae1e0f2ab8493cb12abbaf01f1833a. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:47:42.204626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Getting quotas for user 0d4dc87fae144ab9a40e1f047330168d and project aaae1e0f2ab8493cb12abbaf01f1833a. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:47:42.246480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:47:42.249228 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:47:42.416476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-67351c2c-e2df-4b9e-953a-867148bd665f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.478920 Aug 10 22:47:42.417321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 11/23] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:47:42.435813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6b37b4b3-ba45-49ed-a0c0-6a88fa2e3797 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:42.436647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6b37b4b3-ba45-49ed-a0c0-6a88fa2e3797 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:42.579677 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6b37b4b3-ba45-49ed-a0c0-6a88fa2e3797 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:42.613225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6b37b4b3-ba45-49ed-a0c0-6a88fa2e3797 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:42.617659 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6b37b4b3-ba45-49ed-a0c0-6a88fa2e3797 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:42.623330 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6b37b4b3-ba45-49ed-a0c0-6a88fa2e3797 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1279 microversion: 2.20 time: 0.200078 Aug 10 22:47:42.637755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 12/24] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:42 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1279 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:42.658718 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-34186dc1-ebb2-4ac1-ba15-30efbafae6d2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:42.659421 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-34186dc1-ebb2-4ac1-ba15-30efbafae6d2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:42.775208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e0701893-8fc2-49c6-9c74-4adc69745a9c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: .version_select at 0x7fa9bfbae430>, body: {"keypair": {"name": "tempest-keypair-1172576208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO28a5/ggXFnVSP/89HEqEIg6GJwX7oXhJh+3+9s1K2AvSdqtn6D/ElrKDp1wDy7nMwQyL5XPrtouvfaerUZ8tkMcQGUK8c0fFV+MbtuxrcJYlpsbW5IJgs7ZOPBobhpuA=="}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:42.843530 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-e0701893-8fc2-49c6-9c74-4adc69745a9c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:47:42.859001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-e0701893-8fc2-49c6-9c74-4adc69745a9c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:47:42.862758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34186dc1-ebb2-4ac1-ba15-30efbafae6d2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:42.876654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-34186dc1-ebb2-4ac1-ba15-30efbafae6d2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1215 microversion: 2.1 time: 0.237723 Aug 10 22:47:42.889887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 13/25] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:42 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:42.963333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e0701893-8fc2-49c6-9c74-4adc69745a9c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.990198 Aug 10 22:47:42.963952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 13/26] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:47:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:43.659259 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e1baa9b8-67e5-481f-a8bd-01af522ebf9e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:43.660164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e1baa9b8-67e5-481f-a8bd-01af522ebf9e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:43.853044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2fbdceef-ec01-449e-9098-1f263c691d97 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'create', calling method: .version_select at 0x7fa9bfb73820>, body: {"keypair": {"name": "tempest-keypair-643217114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaCbo+q6o4bkOixrQl/EUxDr2BGtxjNBT6sl/3Fihj7EJQcK1wf7q7yQEdcpZGVRY4BXssD9BlTC9PbmWvDdchR2gjSrEuQkpLHTH7uHArogerM2ZMbG7cBvQefuM/v/w=="}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:43.893265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-2fbdceef-ec01-449e-9098-1f263c691d97 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for project b81a25303ced4ea4bf5351ec42192c13. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:47:43.907605 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-2fbdceef-ec01-449e-9098-1f263c691d97 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for user 405738ed219b4fdc8e3c07706a13e5a2 and project b81a25303ced4ea4bf5351ec42192c13. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:47:44.048259 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e1baa9b8-67e5-481f-a8bd-01af522ebf9e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:44.063572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2fbdceef-ec01-449e-9098-1f263c691d97 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.871091 Aug 10 22:47:44.068108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 14/27] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:47:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:44.085093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-35edbb92-2592-4972-82d7-709234617c67 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:44.085925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-35edbb92-2592-4972-82d7-709234617c67 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:44.086831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e1baa9b8-67e5-481f-a8bd-01af522ebf9e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:44.091357 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e1baa9b8-67e5-481f-a8bd-01af522ebf9e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:44.094571 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e1baa9b8-67e5-481f-a8bd-01af522ebf9e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1279 microversion: 2.20 time: 0.441816 Aug 10 22:47:44.101250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 14/28] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:43 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1279 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:44.483499 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-35edbb92-2592-4972-82d7-709234617c67 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:44.495438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-35edbb92-2592-4972-82d7-709234617c67 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1215 microversion: 2.1 time: 0.424318 Aug 10 22:47:44.499934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 15/29] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:44 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:45.147444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4a2e67a4-ea90-42c9-ada9-561752efce31 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:45.148867 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4a2e67a4-ea90-42c9-ada9-561752efce31 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:45.520943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:45.521585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:45.539703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:45.540211 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:45.540646 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:45.546306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:45.547397 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:45.548888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:45.627334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4a2e67a4-ea90-42c9-ada9-561752efce31 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:45.660397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4a2e67a4-ea90-42c9-ada9-561752efce31 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:45.667415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4a2e67a4-ea90-42c9-ada9-561752efce31 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:45.673883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4a2e67a4-ea90-42c9-ada9-561752efce31 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1279 microversion: 2.20 time: 0.545234 Aug 10 22:47:45.678201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 15/30] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:45 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1279 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:46.199291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:46.240844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b8e542d9-bb37-496d-9c25-4b5a5bdad8d6 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1219 microversion: 2.1 time: 0.723610 Aug 10 22:47:46.250073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 16/31] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:45 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1219 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:47:46.701919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:46.702577 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:46.714072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:46.714567 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:46.715008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:46.715708 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:46.718234 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:46.718677 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:47.134758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:47.169216 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:47.173602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:47.179893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c5834687-49f2-47ce-925a-7bce334ab52b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1275 microversion: 2.20 time: 0.483119 Aug 10 22:47:47.185903 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 16/32] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:46 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1275 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:47.280493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:47.281220 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:47.296308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:47.299097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:47.300612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:47.302509 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:47.304887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:47.306554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:47.857300 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:47.891658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1c7715a2-443e-47cc-b865-d6da21a9645f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1285 microversion: 2.1 time: 0.619119 Aug 10 22:47:47.895844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 17/33] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:47 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1285 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:48.215213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:48.216522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:48.232440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:48.234479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:48.235335 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:48.238471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:48.239473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:48.246764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:48.534598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:48.557998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:48.566030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:48.571099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0c077f0e-d9d4-48e4-8f86-b6e98e186db8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1337 microversion: 2.20 time: 0.360309 Aug 10 22:47:48.589975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 17/34] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:48 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1337 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:48.919276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:48.922503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:48.936516 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:48.938902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:48.939708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:48.943069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:48.943798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:48.945533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:49.136620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:49.164062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e012de12-fefd-48f7-8d24-92725cdf83cc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1273 microversion: 2.1 time: 0.245604 Aug 10 22:47:49.166241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 18/35] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:48 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:49.595429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:49.596656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:49.610998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:49.611788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:49.613970 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:49.614889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:49.618103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:49.619109 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:50.075917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:50.132556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1000053331", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67b001b8-3d70-41ad-865c-43e8ac074765"}], "security_groups": [{"name": "tempest-securitygroup--295398576"}], "key_name": "tempest-keypair-1172576208", "user_data": "}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:50.142935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:50.203723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:50.217893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7056cdf6-abbf-457a-be56-f73fc66a9217 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1337 microversion: 2.20 time: 0.622256 Aug 10 22:47:50.229583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 18/36] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:49 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1337 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:50.296501 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:50.306989 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:50.353485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:50.357596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:50.363083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:50.371796 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:50.388564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:50.390211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:51.641154 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:52.074559 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] validate_networks() for [('67b001b8-3d70-41ad-865c-43e8ac074765', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:47:52.160691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:52.260407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:52.276889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0d3c572b-ac6d-4a1f-aa04-2617503289a9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 2.037577 Aug 10 22:47:52.278306 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 19/37] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:50 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:52.283769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:52.289135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:52.301138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:52.301961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:52.302632 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:52.305952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:52.306676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:52.307397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:52.552637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:52.579249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:52.580786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:52.589345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-67ec700a-4160-46f6-b2a4-7f3975654042 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1337 microversion: 2.20 time: 0.309700 Aug 10 22:47:52.589951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 20/38] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:52 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1337 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:52.817908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-674991843", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3c018dd-0e2f-4505-af82-5b32938180f6"}], "security_groups": [{"name": "tempest-securitygroup--2088266919"}], "key_name": "tempest-keypair-643217114", "user_data": "}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:53.839547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] validate_networks() for [('e3c018dd-0e2f-4505-af82-5b32938180f6', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:47:54.031046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:47:54.033992 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:47:54.034546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:47:54.034930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:47:54.035526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:47:54.072901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:54.073425 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:54.078527 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:54.081130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:54.105347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:54.106874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:54.186881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:47:54.207567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:47:54.262989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:47:54.265320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:47:54.471789 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2fd8a514-7db5-406c-8453-cae150a84de7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.343871 Aug 10 22:47:54.497484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:47:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 4370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:47:54.502561 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:54.503173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:54.519883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:54.519883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:54.524895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:54.525740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:54.534001 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:54.534514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:55.652261 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=14 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:55.809949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:55.829641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1dcaef8a-f5cd-4d45-b8fa-47c0a8236ff2 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 1.330826 Aug 10 22:47:55.830591 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 20/40] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:54 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:55.854909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:55.858924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:55.872170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:55.872810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:55.873345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:55.878475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:55.878961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:55.879408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:56.422438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:56.451251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:56.455980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:56.460691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5ce481be-5946-47aa-b745-0e8cc1f38c6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.624292 Aug 10 22:47:56.465242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 21/41] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:55 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:56.481817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:56.482591 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:56.512675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:56.517694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:56.519842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:56.521434 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:56.523031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:56.523625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:56.784008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:47:56.784569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:47:56.784830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:47:56.786747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:47:56.786747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:47:56.845094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:56.847979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:56.850476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:56.851230 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:56.856566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:56.859585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5469f5a5-58f4-413d-871a-bd94b9733b40 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1238 microversion: 2.1 time: 0.389259 Aug 10 22:47:56.861441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 22/42] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:56 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1238 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:56.869681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:56.870562 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:56.960054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for project b81a25303ced4ea4bf5351ec42192c13. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:47:56.978176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for user 405738ed219b4fdc8e3c07706a13e5a2 and project b81a25303ced4ea4bf5351ec42192c13. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:47:57.020531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:47:57.025004 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:47:57.047249 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-dd3f5ab2-7e45-4054-9dfd-9e818251e7bf req-599dff98-53d2-4f4a-abb2-c3fc378fb045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5", "tag": "241ce478-addd-4d55-a11c-efd8025f509c"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:57.117676 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-dd3f5ab2-7e45-4054-9dfd-9e818251e7bf req-599dff98-53d2-4f4a-abb2-c3fc378fb045 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.119314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-dd3f5ab2-7e45-4054-9dfd-9e818251e7bf req-599dff98-53d2-4f4a-abb2-c3fc378fb045 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.119952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-dd3f5ab2-7e45-4054-9dfd-9e818251e7bf req-599dff98-53d2-4f4a-abb2-c3fc378fb045 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.130891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-70dbb835-4031-4b8d-896c-e07a04365a87 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.317168 Aug 10 22:47:57.135031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 21/43] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:47:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 4322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:47:57.155563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:57.158801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:57.180431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.182598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.183603 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.201881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.206202 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.207077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-dd3f5ab2-7e45-4054-9dfd-9e818251e7bf req-599dff98-53d2-4f4a-abb2-c3fc378fb045 service nova] Creating event network-changed:241ce478-addd-4d55-a11c-efd8025f509c for instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 on hv-cinder-83608 Aug 10 22:47:57.207815 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-dd3f5ab2-7e45-4054-9dfd-9e818251e7bf req-599dff98-53d2-4f4a-abb2-c3fc378fb045 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 22:47:57.208216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-dd3f5ab2-7e45-4054-9dfd-9e818251e7bf req-599dff98-53d2-4f4a-abb2-c3fc378fb045 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 22:47:57.208812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.209312 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.209880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.210631 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.211713 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.212177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.212604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.313443 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.compute.rpcapi [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 22:47:57.314254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=132541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 22:47:57.392240 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4ece68bf-693f-42d2-b477-0eae559bb7a6 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.527935 Aug 10 22:47:57.393075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 23/44] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:57.399019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0e14182c-6378-4bde-a5f3-1611f90f7385 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:57.410741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0e14182c-6378-4bde-a5f3-1611f90f7385 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:57.558400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0e14182c-6378-4bde-a5f3-1611f90f7385 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:57.567491 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0e14182c-6378-4bde-a5f3-1611f90f7385 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1236 microversion: 2.1 time: 0.172904 Aug 10 22:47:57.571991 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 24/45] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:57 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1236 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:57.582383 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:57.583577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:57.600863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.602118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.609326 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.611586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.612391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.613164 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.768849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:57.781908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-38cda35d-fda3-4f19-a143-86866841fe5c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.645135 Aug 10 22:47:57.802625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 22/46] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:57 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:57.887046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:57.887848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:57.901226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.902083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.902213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:57.902654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.903303 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:57.903763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:57.904227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:57.921646 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:57.923691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:57.925124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-74361bd1-d1e1-4eaf-9ee7-7f036f4cfb0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.351753 Aug 10 22:47:57.926672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 25/47] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:57 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:58.067842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:58.076101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ef45f745-3c13-4857-ae3d-1289528b0972 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.194145 Aug 10 22:47:58.076695 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 23/48] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:57 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:47:58.201573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-4236bc26-e9d4-4dea-9e20-45b549afc4a7 req-896cb5f1-f36f-4b79-94ce-ad7cfa9b7c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0", "tag": "1090c7bb-79eb-4915-b7e9-12cdfafe465a"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:58.211033 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-4236bc26-e9d4-4dea-9e20-45b549afc4a7 req-896cb5f1-f36f-4b79-94ce-ad7cfa9b7c56 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:58.211520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-4236bc26-e9d4-4dea-9e20-45b549afc4a7 req-896cb5f1-f36f-4b79-94ce-ad7cfa9b7c56 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:58.211957 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-4236bc26-e9d4-4dea-9e20-45b549afc4a7 req-896cb5f1-f36f-4b79-94ce-ad7cfa9b7c56 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:58.223661 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-4236bc26-e9d4-4dea-9e20-45b549afc4a7 req-896cb5f1-f36f-4b79-94ce-ad7cfa9b7c56 service nova] Creating event network-changed:1090c7bb-79eb-4915-b7e9-12cdfafe465a for instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 on hv-cinder-83608 Aug 10 22:47:58.229371 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-4236bc26-e9d4-4dea-9e20-45b549afc4a7 req-896cb5f1-f36f-4b79-94ce-ad7cfa9b7c56 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084190 Aug 10 22:47:58.231925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 26/49] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:58.600824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:58.601608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:58.608616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:58.609175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:58.609727 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:58.610449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:58.610948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:58.611389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:58.712477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:58.721341 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c54449bd-1f6d-4968-a6c1-7a3703e95f01 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.132868 Aug 10 22:47:58.721833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 24/50] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:58 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:58.811792 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:58.812719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:58.819678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:58.820159 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:58.820592 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:58.821303 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:58.821757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:58.822175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:58.950925 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:58.951788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:58.957870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:58.958365 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:58.958811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:58.960149 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:58.960610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:58.961037 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:59.119670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:59.136716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fbeebfb2-05dc-4970-9415-d08158c62eed tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.325104 Aug 10 22:47:59.146431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 27/51] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:58 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:59.154121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:59.154734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:59.161821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:59.162319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:59.162891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:59.163801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:59.164619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:59.165218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:59.165370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:59.173849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:59.175365 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:59.176591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9639b8e8-8fe2-4330-a5a8-296110e247eb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.229527 Aug 10 22:47:59.177340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 25/52] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:47:58 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:47:59.244099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:59.251453 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bb80c7d0-65ba-4e03-b533-41c810922337 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.101259 Aug 10 22:47:59.252024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 28/53] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:59 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:59.743390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:59.744463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:47:59.751373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:59.752011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:59.752657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:59.753600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:47:59.754053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:47:59.754515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:47:59.819518 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:47:59.827405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fc033418-0bbb-4a77-a23e-af1aee561d71 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.088570 Aug 10 22:47:59.827986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 26/54] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:47:59 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:00.157888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:00.158493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:00.164718 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.165195 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.165667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.166350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.166798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.167212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.200842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:00.202341 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:00.208664 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.209927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.210535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.211301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.211781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.212235 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.347749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:00.355297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-904c5164-b7f4-4e4a-8dd2-cb4de1520425 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.201109 Aug 10 22:48:00.356057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 29/55] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:00 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:00.370451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:00.371264 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:00.376807 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:00.378828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.379396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.379902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.380608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.381053 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.382127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.385966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:00.395983 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:00.396382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:00.398395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f1143f61-2c96-4435-a791-1bf2a8818d17 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.201179 Aug 10 22:48:00.399323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 27/56] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:00 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:00.460775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:00.468525 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1aee5d54-ea94-4d43-a750-7ed67718dfe2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.103300 Aug 10 22:48:00.469105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 30/57] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:00 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:00.848801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:00.849443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:00.856452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.856940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.857406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.858102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:00.858554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:00.859000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:00.930626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:00.938204 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9a90d4b9-08eb-4ebf-8c60-31548b3aeeef tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.093194 Aug 10 22:48:00.938779 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 28/58] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:00 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:01.376024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:01.376722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:01.383596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.384169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.384669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:01.385601 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.386057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.386609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:01.423460 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:01.425178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:01.432563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.433057 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.433735 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:01.434811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.435492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.436976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:01.599280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:01.609347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8f6efc78-0725-453d-be84-ee3f1a92ee3d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.237900 Aug 10 22:48:01.610167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 31/59] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:01 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:01.624595 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:01.625000 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:01.625641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:01.632118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.632801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.633235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:01.634271 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.634751 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.635146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:01.635757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:01.637507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:01.638869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-af7bc3fb-af77-4483-823f-bc35ac2535fa tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.222293 Aug 10 22:48:01.640025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 29/60] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:01 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:01.703806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:01.711965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b02958a7-5e0a-425d-b49d-764241bb66c1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.100030 Aug 10 22:48:01.712627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 32/61] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:01 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:01.961611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:01.962145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:01.968048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.968528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.968959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:01.969656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:01.970106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:01.970525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:02.029715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:02.037096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cb4da6e2-e0a6-4833-8ddd-b3ce5a22ce6a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.080069 Aug 10 22:48:02.037750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 30/62] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:01 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:02.635266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:02.635883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:02.641848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:02.642336 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:02.642767 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:02.643454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:02.643915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:02.644319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:02.663772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:02.665031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:02.671645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:02.672256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:02.672817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:02.673643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:02.674155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:02.674640 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:02.854844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:02.868296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:02.871096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2ba9dd0a-59b3-49cf-830b-2f13b3ee999d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.239636 Aug 10 22:48:02.876891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:02.878447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:02.879566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2ca40ddb-f3df-4b81-802f-9bf288ff47c3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.220369 Aug 10 22:48:02.880402 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 31/63] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:02 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:02.884837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:02.885472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:02.889077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 33/64] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:02 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:02.899098 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:02.899450 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:02.899895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:02.900608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:02.901059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:02.901509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:02.980436 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:02.984744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:02.990205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9643abb2-5981-41a6-8df2-10e7b898bb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.108797 Aug 10 22:48:02.991355 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 32/65] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:02 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:03.059205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:03.060050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:03.066322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:03.067029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:03.067460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:03.068203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:03.069269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:03.069860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:03.143737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:03.147304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:03.162034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-90b2ca17-3054-4c67-8781-75204458efcb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.107019 Aug 10 22:48:03.178905 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 34/66] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:03 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:03.896345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:03.899948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:03.904202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:03.904814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:03.907303 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:03.908182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:03.909322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:03.910213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:03.910888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:03.911310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:03.914593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:03.915094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:03.915539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:03.916242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:03.916697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:03.917135 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:04.182291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:04.191662 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:04.193209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:04.200430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5ffe4f45-df56-401a-b578-e21b3b495266 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.298990 Aug 10 22:48:04.202800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 35/67] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:03 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:04.215599 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:04.216608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:04.229631 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:04.234177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:04.236296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:04.238047 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:04.241795 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:04.242276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:04.242708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:04.244271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-64aa7a51-3542-41eb-bcfd-6cddb48ae244 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.351643 Aug 10 22:48:04.246084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 33/68] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:03 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:04.251862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:04.252662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:04.259566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:04.260538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:04.261176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:04.263351 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:04.264707 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:04.265381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:04.376692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:04.385841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c6ea27fb-3895-49e8-8663-8c2d2d9253ca tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.181611 Aug 10 22:48:04.387220 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 36/69] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:04 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:04.401597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:04.411737 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-92aa8f6d-d266-4981-9ec2-944a43fca641 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.164159 Aug 10 22:48:04.414528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 34/70] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:04 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:05.228063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:05.228724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:05.235130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.235688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.236325 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.237174 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.237688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.238160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.267647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:05.268307 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:05.270163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:05.276187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.277046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.277673 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.278579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.279204 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.279807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.468527 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:05.472176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:05.479009 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:05.480640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:05.481994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d801afb1-bd5f-4be5-93d5-e517078b5320 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.258813 Aug 10 22:48:05.482747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 37/71] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:05 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:05.483182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7a51867d-4931-4dbb-b4e5-d73be7c67e2c tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.219319 Aug 10 22:48:05.488447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:05.489135 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:05.493805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 35/72] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:05 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:05.500404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:05.502652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:05.504063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.504927 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.505488 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.506940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.507512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.508213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.513016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.513912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.514283 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.515373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:05.516731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:05.517823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:05.597708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:05.606879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d68b3ce4-4e11-4418-a6ef-95151f906756 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.121919 Aug 10 22:48:05.607550 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 38/73] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:05 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:05.624923 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:05.633249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3116dba9-6206-4d06-931c-9ee208360f85 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.137896 Aug 10 22:48:05.648551 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 36/74] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:05 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:06.504401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:06.505616 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:06.509485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:06.509944 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:06.511847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.512332 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.512953 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.513967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.514421 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.514845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.515876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.516350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.516884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.517485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.517933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.518475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.871689 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:06.875826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:06.879697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-994d93a4-8f67-4480-bd74-bb5725a8df6e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.379707 Aug 10 22:48:06.880261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 39/75] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:06 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:06.885765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:06.887355 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:06.888677 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c7d10671-cdbb-48ec-959a-3d631879dd4f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.383991 Aug 10 22:48:06.890575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:06.891418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:06.897618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 37/76] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:06 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:06.899343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.899983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.900581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.901471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.902066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.902531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:06.902935 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.903145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:06.910408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.910899 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.911340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.912042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:06.912927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:06.913469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:06.929547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:06.991987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:07.003073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-58ecf53f-2772-4b75-9df1-09d4bab215c2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.120430 Aug 10 22:48:07.003073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 40/77] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:06 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:07.007611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=6 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:07.011395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:07.028976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0f4934e4-c81c-44b1-be08-f5ef866789dd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.129613 Aug 10 22:48:07.030060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 38/78] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:06 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:07.901366 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:07.902076 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:07.904186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:07.904885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=28 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:07.913656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:07.914212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:07.914301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:07.914632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:07.915078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:07.915794 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:07.916242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:07.917077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:07.920246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:07.922013 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:07.922453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:07.923900 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:07.924354 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:07.924771 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:08.129989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:08.138758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ea4a95cf-e6ee-4739-b257-d7414cbd7471 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.242395 Aug 10 22:48:08.152665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:08.153007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 41/79] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:07 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:08.160037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:08.160485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:08.160640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:08.162830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:08.164463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bc896100-9e3a-4d9c-93c2-d69202cb2ac1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.254776 Aug 10 22:48:08.165114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 39/80] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:07 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:08.170121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:08.170739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:08.171309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:08.171789 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:08.172294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:08.173237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:08.174443 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:08.175039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:08.177333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:08.178618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:08.179065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:08.180468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:08.180938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:08.182750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:08.257603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:08.270213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6a22d42b-a421-4495-a480-7cff14c94132 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.115098 Aug 10 22:48:08.271335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 42/81] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:08 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:08.276845 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:08.287173 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ede8d564-0876-4636-98f8-778be4f244f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.120838 Aug 10 22:48:08.287869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 40/82] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:08 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:09.164340 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:09.164939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:09.171002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.171476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.171908 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.172702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.173026 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.173471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.188250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:09.189601 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:09.196596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.197192 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.197612 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.198311 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.198765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.199190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.368664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:09.376575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-34da16f9-5287-40c4-a2c0-d859b96eaa34 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.216128 Aug 10 22:48:09.386175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 43/83] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:09 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:09.386175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:09.386175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:09.390678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.391178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.392501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.393267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.393766 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.394255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.402588 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:09.411270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:09.413351 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:09.414505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c90ca0a1-1c43-450b-a16d-8c5a321afae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.230432 Aug 10 22:48:09.415471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 41/84] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:09 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:09.421108 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:09.426172 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:09.436151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.436651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.437093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.437846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:09.438300 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:09.438721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:09.479342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:09.487670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a3185c6a-9da7-4189-b1b0-130ebec8b385 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1294 microversion: 2.1 time: 0.109417 Aug 10 22:48:09.488255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 44/85] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:09 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:09.507081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:09.514431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-94e845bc-dc18-466e-b081-219bf8cb6e2b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1240 microversion: 2.1 time: 0.097736 Aug 10 22:48:09.514994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 42/86] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:09 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:10.398696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:10.400066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:10.406427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.407228 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.407897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.409036 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.409756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.410185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.440888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:10.441614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:10.458753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.460103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.460639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.461398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.461907 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.462336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.884952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:10.893339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:10.894987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:10.896157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-045eb658-332b-4b96-ab35-e38939dee1a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.461530 Aug 10 22:48:10.897498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 43/87] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:10 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:10.902033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:10.902846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:10.908862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.909370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.909807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.910503 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.910954 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.911384 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.917799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:10.925065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d21ced42-392c-491c-a79c-06171a504ef1 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.531468 Aug 10 22:48:10.925820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 45/88] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:10 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:10.932667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:10.933553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:10.939396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.939882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.940325 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.941021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:10.941509 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:10.941934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:10.974031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:10.981633 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-39dc1fb5-543a-411b-8af8-b25b803336d1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1312 microversion: 2.1 time: 0.083110 Aug 10 22:48:10.982232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 44/89] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:10 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:11.007718 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:11.015143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f960f7b5-7ed4-45dc-a9d5-d92277fd9f4e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1288 microversion: 2.1 time: 0.088016 Aug 10 22:48:11.015715 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 46/90] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:10 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:11.919947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:11.920543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:11.926984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:11.927271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:11.928285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:11.928712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:11.929166 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:11.929619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:11.950761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:11.952161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:11.959309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:11.960086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:11.960950 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:11.961880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:11.962528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:11.963140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:12.147859 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:12.151194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:12.161300 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3a7496dc-0d7a-4e0f-9355-fa6fc57f0535 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.217374 Aug 10 22:48:12.162292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 47/91] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:11 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:12.167525 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:12.168192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:12.174691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:12.174997 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:12.175484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:12.175845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:12.176551 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:12.176913 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:12.177038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:12.177445 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:12.178530 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4c90c8ab-b788-43e0-b19c-2d3740f24c70 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.262437 Aug 10 22:48:12.179566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 45/92] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:11 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:12.184242 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:12.185118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:12.191274 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:12.191985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:12.192621 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:12.194356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:12.195037 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:12.195677 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:12.244978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:12.254585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-53fae7c4-09b1-4b86-a9a1-8a6beb0cb9ee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1312 microversion: 2.1 time: 0.091115 Aug 10 22:48:12.255261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 48/93] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:12 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:12.289256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:12.296689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d699ba5d-86ee-4078-9648-502abca8a4bb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1288 microversion: 2.1 time: 0.115941 Aug 10 22:48:12.297471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 46/94] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:12 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1288 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:13.183800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:13.185080 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:13.193638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.194655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.195181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.198447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.199159 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.199839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.202742 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:13.203896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:13.218797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.219295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.219768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.220938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.221690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.222284 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.401011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:13.409457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-19df1caa-e3e1-4a37-a490-3067e83c0b5d tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.230219 Aug 10 22:48:13.409743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 49/95] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:13 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:13.415582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:13.416444 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:13.428062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.429315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.432646 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.433519 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.434184 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.434801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.435034 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:13.447497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:13.449118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:13.450462 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ba7bee23-6863-4105-b3af-955b2c48365a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.252175 Aug 10 22:48:13.451141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 47/96] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:13 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:13.455907 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:13.456745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:13.463828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.464526 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.465346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.466705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:13.467184 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:13.467584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:13.512408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:13.520057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-74626d81-c623-41e7-ba84-d98d656a3c58 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1312 microversion: 2.1 time: 0.108989 Aug 10 22:48:13.520636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 50/97] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:13 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:13.548412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:13.556670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1b50ceb5-698d-4455-920f-b72196af7228 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1288 microversion: 2.1 time: 0.104492 Aug 10 22:48:13.557295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 48/98] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:13 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:14.443618 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:14.450804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:14.477482 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:14.478850 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:14.479500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:14.480029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:14.480486 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:14.494292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:14.494875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:14.495313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:14.497335 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:14.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:14.508665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:14.511325 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:14.512138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:14.513137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:14.541606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:14.560072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:15.195517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:15.209048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cc3601ed-5ba2-4441-aedf-efe39d0e38d0 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.772269 Aug 10 22:48:15.223526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 51/99] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:14 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:15.230696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:15.231865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:15.252139 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:15.257162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:15.257960 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:15.259046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:15.260169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:15.262280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:15.337107 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:15.346852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:15.350017 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:15.351479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2ed03d42-462d-43a0-91a2-6a6b68ece3ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.880613 Aug 10 22:48:15.352740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 49/100] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:14 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:15.361867 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:15.362884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:15.373586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:15.374089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:15.374540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:15.375243 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:15.375878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:15.376496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:15.436311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:15.448602 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-153485e4-4b7e-49c2-a0c7-1f14a9be892b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1300 microversion: 2.1 time: 0.223037 Aug 10 22:48:15.449302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 52/101] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:15 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1300 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:15.501117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:15.512491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a264b19b-06b2-4cfd-892e-f5299d25895f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1294 microversion: 2.1 time: 0.158277 Aug 10 22:48:15.513087 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 50/102] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:15 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:16.231348 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:16.231964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:16.252970 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.253576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.254017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:16.258058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.258479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.258923 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:16.378602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:16.379370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:16.394837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.395345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.395882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:16.405078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.410367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.413897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:16.766171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:16.782174 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-57b27bf1-3206-4090-900d-5a7e403284cd tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.554697 Aug 10 22:48:16.783400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 53/103] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:16 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:16.783657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:16.794745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:16.794985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:16.796707 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-af713fab-ada9-4510-8234-a617ce34330b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.423788 Aug 10 22:48:16.798885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 51/104] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:16 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:16.800078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:16.800856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:16.812694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.814710 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:16.819476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.820279 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:16.820990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:16.821207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.821814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.822251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:16.834115 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.835633 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.836912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:16.844130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:16.844740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:16.845836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:17.135380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:17.142860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-829936ce-256d-447b-a966-4b067f5a1739 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.357404 Aug 10 22:48:17.143641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 54/105] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:16 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:17.154149 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:17.182022 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-336a44c7-8cee-4e34-9044-24b95006b271 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.374939 Aug 10 22:48:17.183510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 52/106] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:16 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:17.482554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-7d4ebce2-9011-4d1d-b247-6df14049e4aa req-274c298a-be58-42b7-b32d-499b4bfe17d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5", "name": "network-vif-plugged", "status": "completed", "tag": "241ce478-addd-4d55-a11c-efd8025f509c"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:17.493484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-7d4ebce2-9011-4d1d-b247-6df14049e4aa req-274c298a-be58-42b7-b32d-499b4bfe17d2 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:17.493968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-7d4ebce2-9011-4d1d-b247-6df14049e4aa req-274c298a-be58-42b7-b32d-499b4bfe17d2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:17.494399 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-7d4ebce2-9011-4d1d-b247-6df14049e4aa req-274c298a-be58-42b7-b32d-499b4bfe17d2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:17.506181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-7d4ebce2-9011-4d1d-b247-6df14049e4aa req-274c298a-be58-42b7-b32d-499b4bfe17d2 service nova] Creating event network-vif-plugged:241ce478-addd-4d55-a11c-efd8025f509c for instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 on hv-cinder-83608 Aug 10 22:48:17.512438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-7d4ebce2-9011-4d1d-b247-6df14049e4aa req-274c298a-be58-42b7-b32d-499b4bfe17d2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163852 Aug 10 22:48:17.513201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 55/107] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:48:17.808496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:17.810838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:17.818447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:17.819301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:17.822392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:17.823613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:17.824401 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:17.834856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:17.836554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:17.840157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:17.850195 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:17.851218 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:17.854048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:17.870851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:17.874128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:17.874577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:18.182293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:18.192639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-081c7bb4-aae4-4112-b583-ca0902db05b4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.389761 Aug 10 22:48:18.194763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 53/108] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:17 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:18.205386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:18.206346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:18.217150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:18.229532 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:18.230910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:18.231757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:18.232736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:18.235837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:18.236595 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:18.236748 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:18.237823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:18.239522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a65552af-1706-4fe0-b3c3-111901d92e8b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.413458 Aug 10 22:48:18.242583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 56/109] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:17 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:18.251275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:18.252352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:18.273239 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:18.274885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:18.276307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:18.278124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:18.278743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:18.279335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:18.650296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:18.659018 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d7f00579-f992-47f5-8c2c-267c500b19bd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.462873 Aug 10 22:48:18.661355 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 54/110] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:18 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:18.719745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:18.742028 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9bc676e9-5d92-43cc-8fe4-fe681f87d45a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.496308 Aug 10 22:48:18.757318 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 57/111] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:18 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:19.214331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:19.215280 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:19.225666 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.231442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.232497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.233519 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.234137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.234744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.267289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:19.267805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:19.278011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.279595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.280788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.283456 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.284142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.285866 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.643842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:19.652683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:19.658992 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:19.659474 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f2436fcc-dadd-4e23-871e-1c7828462b62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.396963 Aug 10 22:48:19.667398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:19.678403 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 58/112] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:19 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:19.687773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-778c7236-451a-4722-a8a2-1c86dd0d0bb9 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.477215 Aug 10 22:48:19.687991 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-062a9abd-0dae-43a9-b615-0d7c194cb4f8 req-7b704f61-d280-41f8-8f17-e0b8a33b6b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b5a255-e068-46e0-8c6d-bdde4a91c933", "tag": "9c856112-b712-4ce2-941b-5d426ef1738d"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:19.688969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 55/113] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:19 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:19.713233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:19.713891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:19.724628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.725378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.726106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.727584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.728272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.728843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.731037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-062a9abd-0dae-43a9-b615-0d7c194cb4f8 req-7b704f61-d280-41f8-8f17-e0b8a33b6b3a service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.732765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-062a9abd-0dae-43a9-b615-0d7c194cb4f8 req-7b704f61-d280-41f8-8f17-e0b8a33b6b3a service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.734779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-062a9abd-0dae-43a9-b615-0d7c194cb4f8 req-7b704f61-d280-41f8-8f17-e0b8a33b6b3a service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.783363 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-062a9abd-0dae-43a9-b615-0d7c194cb4f8 req-7b704f61-d280-41f8-8f17-e0b8a33b6b3a service nova] Creating event network-changed:9c856112-b712-4ce2-941b-5d426ef1738d for instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 on hv-cinder-83608 Aug 10 22:48:19.794709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-062a9abd-0dae-43a9-b615-0d7c194cb4f8 req-7b704f61-d280-41f8-8f17-e0b8a33b6b3a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114939 Aug 10 22:48:19.795649 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 59/114] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:19.803881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:19.805120 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:19.811972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.812475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.812914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:19.813769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:19.814224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:19.814655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:20.065223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:20.077190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-eeb61463-a5ad-4e9c-b2c2-3a1dc57cd867 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.385822 Aug 10 22:48:20.077995 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 56/115] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:19 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:20.081793 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:20.090027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ae191fd0-5b89-4a69-a186-286461c69a5c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.293120 Aug 10 22:48:20.090978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 60/116] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:19 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:20.688103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:20.688691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:20.695277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:20.695758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:20.696393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:20.697085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:20.697720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:20.698158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:20.712353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:20.716625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:20.723881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:20.725459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:20.726161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:20.727516 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:20.728715 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:20.729373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.022280 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:21.034762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:21.034998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:21.036975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:21.039134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-727aa0fa-c5d6-4c9f-ba5a-7a6397b61bee tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.354913 Aug 10 22:48:21.041410 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 57/117] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:20 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:21.047984 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f939cfe8-9cf5-4218-b5cb-aa8a90045326 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1315 microversion: 2.1 time: 0.341343 Aug 10 22:48:21.063502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 61/118] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:20 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:21.099791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:21.101033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:21.109774 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:21.110266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:21.113426 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:21.114165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:21.115977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.117291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:21.117791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:21.119419 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.124493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:21.125290 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:21.127702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.128797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:21.129560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:21.130785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.859784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:21.872687 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e1342e22-cdc5-4ebe-aca0-4e2983bb0414 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.776808 Aug 10 22:48:21.876302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 58/119] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:21 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:21.886651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-1f35c377-1bd0-484b-8858-9f799a7ae791 req-148c28c0-1045-432f-9ef7-77537138d36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cecaf930-d7cc-4ee7-b096-6f206dc50e7a", "tag": "fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:21.911132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1f35c377-1bd0-484b-8858-9f799a7ae791 req-148c28c0-1045-432f-9ef7-77537138d36b service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:21.913193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1f35c377-1bd0-484b-8858-9f799a7ae791 req-148c28c0-1045-432f-9ef7-77537138d36b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:21.913911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1f35c377-1bd0-484b-8858-9f799a7ae791 req-148c28c0-1045-432f-9ef7-77537138d36b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.940059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-1f35c377-1bd0-484b-8858-9f799a7ae791 req-148c28c0-1045-432f-9ef7-77537138d36b service nova] Creating event network-changed:fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d for instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a on hv-cinder-83608 Aug 10 22:48:21.941249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1f35c377-1bd0-484b-8858-9f799a7ae791 req-148c28c0-1045-432f-9ef7-77537138d36b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 22:48:21.941875 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1f35c377-1bd0-484b-8858-9f799a7ae791 req-148c28c0-1045-432f-9ef7-77537138d36b service nova] Acquired lock "compute-rpcapi-router" {{(pid=132540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 22:48:21.944414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:21.945092 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:21.945910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:21.946875 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.947836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:21.949610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:21.951320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:21.954533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5ea2ce80-e4c9-47fc-866a-b722895719fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.846388 Aug 10 22:48:21.964710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 62/120] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:21 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:21.966536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.compute.rpcapi [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 22:48:21.968184 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] Releasing lock "compute-rpcapi-router" {{(pid=132540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 22:48:21.997158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c4815257-9e57-4d6c-95dd-628ba0e189cf None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118067 Aug 10 22:48:21.998388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 59/121] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:22.071172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:22.072051 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:22.078856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:22.079519 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:22.080400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:22.080567 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:22.081748 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:22.082368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:22.082977 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:22.083762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:22.090700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:22.091429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:22.092038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:22.092921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:22.093610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:22.094206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:22.415205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:22.422753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-380f74fb-c569-4876-9d52-f05400e2c632 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1502 microversion: 2.1 time: 0.350555 Aug 10 22:48:22.431599 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:22.435669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 60/122] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:22 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1502 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:22.443558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:22.446498 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:22.447630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d5af6a54-17f6-497c-8998-4ab991d25e30 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.384058 Aug 10 22:48:22.448189 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 63/123] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:22 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:22.896340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:22.896971 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:22.921737 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:22.922505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:22.924335 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:22.928213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:22.930050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:22.931586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:22.988773 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:22.991790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:23.003485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:23.004219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:23.006466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:23.007562 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:23.008499 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:23.009102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:23.336598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:23.344182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c574ec06-4820-4559-883e-72824c5a1d73 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.451962 Aug 10 22:48:23.344754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 61/124] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:22 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:23.361404 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:23.374292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cd178cc5-22bb-49b2-8d71-b4a1414b603e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.392287 Aug 10 22:48:23.374952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 64/125] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:22 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:23.480576 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:23.481194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:23.487673 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:23.488377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:23.489030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:23.490812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:23.491479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:23.491930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:23.673718 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:23.687931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:23.697298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:23.698470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-58e46796-7824-47cc-bac1-c970a74105c1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.221793 Aug 10 22:48:23.699547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 62/126] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:23 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:24.149894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe80311d-7703-4930-8442-1205c1069944"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:24.152269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:24.158216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.158695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.159125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.159924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.160382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.160799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.368717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:24.369372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:24.377566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.378113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.378561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.379313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.379768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.380372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.544932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:24.553899 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ff4bc46f-5147-449d-83a7-b50eca52369c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.192372 Aug 10 22:48:24.555121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 63/127] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:24 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:24.572672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:24.573253 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:24.580500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.580948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.581390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.582266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.582708 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.583367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.585983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-48da9e93-fd82-45ea-a421-abfc69ff7217 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "POST /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439417 Aug 10 22:48:24.586703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 65/128] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:48:24 2022] POST /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:24.721803 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:24.722500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:24.734606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:24.743970 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.744484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.744871 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-550e1b5d-5b06-4673-9aee-9f4ddec26fcd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.188246 Aug 10 22:48:24.744993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.759441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 64/129] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:24 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:24.759880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:24.759880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:24.759880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:24.849124 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1126701", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "networks": [{"uuid": "59ff0254-3444-444b-935b-be74ef3dbe67"}]}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:24.915722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] validate_networks() for [('59ff0254-3444-444b-935b-be74ef3dbe67', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:48:25.015360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:25.029642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:25.031138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:25.040319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b1701131-7f3e-4e6d-8c2e-72b9e9ad6721 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.322759 Aug 10 22:48:25.041268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 66/130] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:24 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:25.128641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2008958218", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "networks": [{"uuid": "36b5ad33-0d5e-4960-96b9-1be5cca12db2"}]}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:25.210876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] validate_networks() for [('36b5ad33-0d5e-4960-96b9-1be5cca12db2', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:48:25.518178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:48:25.518699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:48:25.519125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:48:25.519601 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:48:25.520084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:48:25.529639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.530126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.530562 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.531342 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.531738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.532161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.549389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Getting quotas for project 50a0ee776f574f46bdb5f16c1b864402. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:48:25.554422 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Getting quotas for user 0f645ba95eb64bb2b23d0d38a141307a and project 50a0ee776f574f46bdb5f16c1b864402. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:48:25.570846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:48:25.573561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:48:25.623968 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-713e4d26-8f80-4ab6-bdc9-dfacdce14b2a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781076 Aug 10 22:48:25.631119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 65/131] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:48:25.631119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-da262174-54c5-4762-b1dd-7b3ba9390459 req-de7994f1-75e8-4f54-bde7-802c2c9c826e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0", "name": "network-vif-plugged", "status": "completed", "tag": "1090c7bb-79eb-4915-b7e9-12cdfafe465a"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:25.640499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-da262174-54c5-4762-b1dd-7b3ba9390459 req-de7994f1-75e8-4f54-bde7-802c2c9c826e service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.640982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-da262174-54c5-4762-b1dd-7b3ba9390459 req-de7994f1-75e8-4f54-bde7-802c2c9c826e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.641454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-da262174-54c5-4762-b1dd-7b3ba9390459 req-de7994f1-75e8-4f54-bde7-802c2c9c826e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.653909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-da262174-54c5-4762-b1dd-7b3ba9390459 req-de7994f1-75e8-4f54-bde7-802c2c9c826e service nova] Creating event network-vif-plugged:1090c7bb-79eb-4915-b7e9-12cdfafe465a for instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 on hv-cinder-83608 Aug 10 22:48:25.669127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-da262174-54c5-4762-b1dd-7b3ba9390459 req-de7994f1-75e8-4f54-bde7-802c2c9c826e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043075 Aug 10 22:48:25.669934 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 66/132] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:25.678265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:25.679269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:25.685775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.686300 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.686729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.687491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.688127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.688695 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.736493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:48:25.736905 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:48:25.737392 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:48:25.737988 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:48:25.738394 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:48:25.748127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.748990 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.750183 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.750910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.751360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.751781 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.770251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Getting quotas for project c38d0effe2b242bbb7ea221ec2da0177. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:48:25.775634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Getting quotas for user 0f3c2f531a5942e6afabb16521523754 and project c38d0effe2b242bbb7ea221ec2da0177. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:48:25.789546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:48:25.792278 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:48:25.842639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6b3e3256-065c-41f6-ab1a-a481f320f6b0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718486 Aug 10 22:48:25.843382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 67/133] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:48:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:48:25.862065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-355e8c08-d625-4fff-ab5c-094ad2ac3e04 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:25.862065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-355e8c08-d625-4fff-ab5c-094ad2ac3e04 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:25.878632 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:25.882590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:25.888305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2c79878f-c480-4251-b0e8-618d834c86db tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.216576 Aug 10 22:48:25.888880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 67/134] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:25 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:25.914594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:25.915654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:25.922649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.923143 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.923686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.924563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:25.925361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:25.926456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:25.949980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-355e8c08-d625-4fff-ab5c-094ad2ac3e04 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:25.960063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-355e8c08-d625-4fff-ab5c-094ad2ac3e04 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1211 microversion: 2.1 time: 0.107627 Aug 10 22:48:25.960773 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 68/135] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:25 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:25.977011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cb4216e6-ab29-456a-b825-267de23959dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:25.977911 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cb4216e6-ab29-456a-b825-267de23959dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:26.047877 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cb4216e6-ab29-456a-b825-267de23959dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:26.059339 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cb4216e6-ab29-456a-b825-267de23959dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1219 microversion: 2.1 time: 0.095917 Aug 10 22:48:26.072239 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 69/136] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:25 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:26.087755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:26.088472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:26.096407 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:26.097094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:26.097675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:26.098558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:26.099141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:26.099709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:26.120130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:26.130057 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-692243bb-630d-4f3d-87b2-1d6cbc2709b3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.230405 Aug 10 22:48:26.131588 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 68/137] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:25 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:26.274747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:26.278649 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:26.285829 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:26.287699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:26.288907 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-13170efc-a0a0-4d7e-8b9b-ad15c302cf41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.215310 Aug 10 22:48:26.289512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 70/138] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:26 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:26.913829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:26.914443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:26.920599 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:26.921082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:26.921747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:26.922291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:26.922745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:26.923205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:26.985416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:26.986881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:27.005962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:27.007504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.007918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.008663 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.009232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.009713 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.010224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.099549 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:27.106824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2dee318e-2f2b-402a-ab8d-c13f1158ec5c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.127617 Aug 10 22:48:27.111468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:27.114380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 71/139] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:26 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:27.120475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5ecab894-693b-4a61-8b97-e2b772da4281 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.210581 Aug 10 22:48:27.121022 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 69/140] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:26 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:27.121883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:27.122598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:27.128571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.129189 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.129755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.131109 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.131669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.132196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.155286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:27.156194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:27.163652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.164169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.164544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.165228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.165857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.166593 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.198283 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:27.206346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c393856a-df04-4dbe-867a-dba3a832ac8c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.090201 Aug 10 22:48:27.207029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 72/141] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:27 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:27.315038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:27.315493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:27.316105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:27.323675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.323862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-45232fdd-7a6e-4c28-9ee9-160d5c5e1d6e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.174150 Aug 10 22:48:27.324162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.324413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 70/142] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:27 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:27.324601 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.325324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:27.325894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:27.326322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:27.457625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:27.466456 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:27.467964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:27.469066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cee539a9-79a1-4ce9-be59-1fb9b9ab181b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.157478 Aug 10 22:48:27.469685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 73/143] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:27 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:28.126969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:28.127579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:28.133644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.134133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.134568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.135251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.135728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.136152 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.142006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:28.142620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:28.149505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.150017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.150442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.151169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.151600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.152025 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.202321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:28.209906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ddbce085-5cbe-4bb2-815d-65f320f3b876 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.086670 Aug 10 22:48:28.210483 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 71/144] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:28 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:28.228626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:28.229239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:28.235081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.235568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.236010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.236699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.237154 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.237637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.311468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:28.318948 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:28.319985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3d66ae86-ff1c-4a90-9394-3737ec20022c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.096037 Aug 10 22:48:28.320647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 72/145] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:28 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:28.326669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ad3d22f0-8621-473d-9800-eab4613ae157 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.188710 Aug 10 22:48:28.327225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 74/146] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:28 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:28.343890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:28.344508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:28.350750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.351224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.351657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.352336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.352782 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.353197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.486602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:28.491812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:28.492420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:28.494346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b1e64f67-9292-453b-85b0-4998b96fe800 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.154317 Aug 10 22:48:28.494921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 73/147] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:28 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:28.498752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.499237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.499707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.500406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:28.500859 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:28.501299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:28.630610 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:28.638612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:28.640086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:28.641165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-71ce367b-ebcf-464a-b78d-4db6b2fe58ba tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.153288 Aug 10 22:48:28.641739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 75/148] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:28 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:29.232265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:29.232857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:29.238787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.239858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.240351 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.241035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.241516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.241933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.302832 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:29.310208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-242ec126-d85c-4e8f-89aa-1da7dcc132ee tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.081824 Aug 10 22:48:29.310772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 74/149] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:29 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:29.340089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:29.340729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:29.347143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.347287 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:29.347620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.347798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:29.348043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.348764 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.349247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.349782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.354062 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.354552 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.354989 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.355680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.356180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.356556 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.424482 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:29.434200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b319722f-57e3-4184-a606-0dc69881e95e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.097304 Aug 10 22:48:29.434414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 76/150] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:29 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:29.510304 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:29.514889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:29.515495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:29.517750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cd9ae695-43d6-4af2-83da-b94ae1c339aa tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.174344 Aug 10 22:48:29.518317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 75/151] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:29 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:29.521972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.522454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.522884 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.523567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.524015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.524441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.654974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:29.663851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0feec4eb-6a63-44dd-b84b-4240e16405b2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.152535 Aug 10 22:48:29.665510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:29.666106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:29.672172 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.672652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.673083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.673810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:29.674262 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:29.674685 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:29.677043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 77/152] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:29 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:29.814127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:29.825896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:29.827413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:29.828527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-eb8e1ff1-cb8e-4bd2-964d-3bbc3b8aabbf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.168676 Aug 10 22:48:29.829085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 76/153] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:29 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:30.330651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.331282 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:30.337832 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.338309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.338743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.339449 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.339874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.340296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.400367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:30.407665 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9ca89afd-a741-44c8-b1e1-8b07f91bff28 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.080865 Aug 10 22:48:30.408230 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 78/154] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:30.454104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.454708 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:30.462622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.463104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.463536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.464217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.464664 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.465084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.524886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:30.532361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0d082bb2-f1bd-4f27-a357-638302bf49ab tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.082135 Aug 10 22:48:30.532980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 77/155] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:30.540501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.541120 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:30.547460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.548111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.548579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.553909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.554382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.556049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.684134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.684855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:30.687111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:30.693214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.693849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.698998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.699762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.700226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.700337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:30.700654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.708686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-831b48f1-3217-4fab-b162-a8ab4a84344b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.172767 Aug 10 22:48:30.709263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 79/156] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:30.836570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:30.846626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-79a29680-baf8-4969-8c71-5c51dcd7da8f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.166040 Aug 10 22:48:30.847684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 78/157] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:30.852310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.852946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:30.858800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.859274 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.859705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:30.860387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:30.860834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:30.861253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.018433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:31.028883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:31.030598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:31.031783 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e3d31395-55c0-4d36-9989-1cbbb04a22ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.184448 Aug 10 22:48:31.033708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 80/158] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:48:31.430029 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:31.430789 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:31.437686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.438208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.438636 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.439330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.439825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.440188 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.502582 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:31.510944 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-976bc0d4-7fc7-42bd-8901-30a5454f26b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.086691 Aug 10 22:48:31.511505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 79/159] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:31 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:31.558584 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:31.559194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:31.565736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.566220 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.566654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.567978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.568431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.569014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.627430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:31.635556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2228d020-924b-4e89-8d76-aaa82e3d1890 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.080915 Aug 10 22:48:31.636110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 81/160] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:31 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:31.733160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:31.733894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:31.740719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.741211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.741681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.742374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.742825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.743258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.869369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:31.869982 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:31.870189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:31.875922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.876404 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.876841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:31.877498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b0ed4859-1a77-4ea9-89c5-36b6832dc8d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.148389 Aug 10 22:48:31.877614 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:31.878260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:31.878369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 80/161] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:31 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:31.878452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.016928 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:32.025315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fc48d5db-dfb0-4f4b-b7d1-fda55c6e1bd3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.160783 Aug 10 22:48:32.025937 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 82/162] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:31 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:32.055472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:32.056104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:32.062977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.063502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.064244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.065085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.065565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.066022 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.199399 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:32.207434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:32.209907 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:32.211043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0aa9a3b0-1110-4427-bbb9-239b82c8dc33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.160115 Aug 10 22:48:32.211625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 81/163] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:32 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:32.531901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:32.532427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:32.538755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.539261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.539684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.540376 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.540839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.541263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.620407 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:32.627964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ad550223-c1aa-4db7-ada2-a52ddaebf52a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.100022 Aug 10 22:48:32.628535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 83/164] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:32 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:32.657513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:32.658117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:32.664364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.664985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.665445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.666128 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.666574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.666988 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.727240 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:32.734771 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-41d1d575-681f-4364-9dc0-a2423e3605e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.082067 Aug 10 22:48:32.735341 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 82/165] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:32 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:32.898580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:32.899357 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:32.907684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.908209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.908640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:32.909441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:32.909892 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:32.910308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.038600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:33.046380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8729b193-df0e-401a-a90f-350fb7bea22b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.151772 Aug 10 22:48:33.046887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 84/166] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:32 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:33.047349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:33.047989 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:33.055037 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.055516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.055950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.056676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.057132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.057580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.192982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:33.200322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-51097216-c644-403b-9659-dce76735052b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.156732 Aug 10 22:48:33.200899 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 83/167] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:33 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:33.233825 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:33.234431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:33.241258 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.241772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.242232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.242906 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.243361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.243787 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.371275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:33.379203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:33.380761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:33.381881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2b6e7d61-5b36-4361-af05-18ade5a7740b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.151912 Aug 10 22:48:33.382444 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 85/168] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:33 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:33.650154 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:33.650783 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:33.656633 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.657109 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.657573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.658250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.658695 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.659112 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.678384 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:33.720454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:33.728594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2185b771-8ab3-4a3e-a9b0-6114a93aa412 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.083381 Aug 10 22:48:33.729163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 84/169] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:33 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:33.755672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:33.756310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:33.762733 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.763222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.763658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.764352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:33.764914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:33.765213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:33.829142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:33.838176 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0b5817ca-f83f-4ec8-b405-5458bef4df09 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.086444 Aug 10 22:48:33.838867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 86/170] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:33 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:34.069200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:34.069758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:34.075629 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.076106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.076536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.077206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.077681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.078095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.210564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:34.218094 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6241eb52-d95e-4077-846a-f89eeb9f8e3f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.153528 Aug 10 22:48:34.218659 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 85/171] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:34 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:34.221723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:34.222336 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:34.228917 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.229448 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.229879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.230579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.231031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.231458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.250165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:34.369686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:34.377146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c324d594-75aa-4576-a5a4-25a9e2d5f2bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.159354 Aug 10 22:48:34.377741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 87/172] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:34 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:34.404399 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:34.405011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:34.411933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.412714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.412838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.413570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.414022 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.414447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.544240 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:34.552715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:34.554275 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:34.555377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b30dca61-2963-46a7-b483-20b5fa838287 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.154945 Aug 10 22:48:34.555938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 86/173] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:34 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:34.749698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:34.750209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:34.756814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.757435 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.757728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.758406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.758853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.759271 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.820762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:34.828204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-88fdf8e9-624a-4746-8ddb-ddf38d7358ed tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.082375 Aug 10 22:48:34.828772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 88/174] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:34 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:34.860907 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:34.861601 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:34.867751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.868220 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.868646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.869332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:34.869778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:34.870190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:34.931464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:34.938752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6ace3da2-ac93-446b-80c9-3defffb16232 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.082002 Aug 10 22:48:34.939311 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 87/175] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:34 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:35.251310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:35.251926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:35.258550 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.259035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.259471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.260162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.260620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.261045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.392409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:35.398492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:35.399105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:35.400268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b190ab96-1a33-4c88-a349-f85641d49bee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.152725 Aug 10 22:48:35.400848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 89/176] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:35 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:35.405165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.405678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.406184 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.406959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.407421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.407858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.540027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=4 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:35.543880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:35.552485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f14ab8a6-e129-4ccd-87db-2ac89839412e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.157225 Aug 10 22:48:35.553075 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 88/177] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:35 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:35.577633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:35.578237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:35.584584 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.585102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.585585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.586269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.586721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.587160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.723934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:35.731827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:35.733344 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:35.734440 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e0a1675a-d949-488e-a98e-f8df5484d8cc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.160782 Aug 10 22:48:35.734993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 90/178] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:35 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:35.849084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:35.849750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:35.851554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=6 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:35.856992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.857511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.857958 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.858644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.859105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.859527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.959919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:35.960465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:35.962430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:35.968693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.969184 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.969659 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:35.970366 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:35.970823 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:35.971253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:36.053880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=10 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:36.103165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:36.110889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fa0fc7cc-0ecd-4c8b-b0f7-705ea3cf3422 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.266193 Aug 10 22:48:36.111456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 89/179] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:35 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:36.130085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:36.137627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6a829dfa-e57e-4cba-b22f-6f9d7b46c8fb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.182219 Aug 10 22:48:36.138190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 91/180] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:35 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:36.421102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:36.421733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:36.429332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:36.430111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:36.435276 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:36.435382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:36.435781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:36.436376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:36.569537 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:36.572760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:36.573400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:36.577093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6f8d9d46-4706-4457-9794-9b96a5b88f78 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.159826 Aug 10 22:48:36.577790 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 90/181] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:36 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:36.579222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:36.579704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:36.580131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:36.580813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:36.581255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:36.581696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:36.711563 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:36.718918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e616e7a5-017a-4f5c-91a5-45ec79f6d86c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.149896 Aug 10 22:48:36.719473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 92/182] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:36 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:36.757943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:36.758509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:36.764485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:36.764982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:36.765434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:36.766129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:36.766587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:36.767014 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:36.895811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:36.903647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:36.905158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:36.906278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-94fad17a-b16b-4240-b1e8-2fbbc01b11e3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.153134 Aug 10 22:48:36.906837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 91/183] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:36 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:37.133090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:37.133745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:37.140275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.140762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.141197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.141918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.142372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.142798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.157885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:37.158522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:37.164616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.165101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.165576 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.166278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.166738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.167158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.206726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:37.215364 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0213eb67-1233-4208-986e-fff134e4cdc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.086596 Aug 10 22:48:37.215978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 93/184] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:37 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:37.237982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:37.245495 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1f80c5db-793d-44a6-bf61-bf93caed189e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.091328 Aug 10 22:48:37.246053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 92/185] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:37 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:37.597296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:37.597904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:37.604307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.605141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.606002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.606722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.607181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.607609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.740931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:37.741662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:37.745212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:37.748123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.748751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.749257 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.750169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.750740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.751228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.752474 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b3504f72-3cce-4cd2-918f-aaa1250ab3a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.158968 Aug 10 22:48:37.753039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 94/186] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:37 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:37.886025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:37.893539 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-aaf74f79-8e62-48c5-83f9-76f2df56e296 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.157193 Aug 10 22:48:37.894099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 93/187] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:37 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:37.930639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:37.931234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:37.937062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.937594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.938022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:37.938698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:37.939150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:37.939567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.071708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:38.079530 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:38.081034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:38.082193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-01e4ffb0-1be0-4812-9b90-db12fa96d699 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.156354 Aug 10 22:48:38.083410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 95/188] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:37 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:38.235909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:38.236433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:38.242385 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.242865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.243300 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.243987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.244443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.244860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.266532 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:38.267136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:38.274126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.274615 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.275052 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.275749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.276203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.276626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.305923 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:38.313886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6c6506e2-29b3-41ef-b1d6-e2778a04d261 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.081888 Aug 10 22:48:38.314485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 94/189] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:38 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:38.336343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:38.344834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2b165231-ac7b-4c15-bc4d-27cde7c82fed tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.082141 Aug 10 22:48:38.345460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 96/190] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:38 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:38.773478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:38.774088 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:38.780059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.780544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.780979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.781704 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.782161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.782580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.916615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:38.916893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:38.917560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:38.925115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.925637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.926075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.927304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:38.927465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:38.927860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:38.930121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e6182b03-e37f-4b3f-9583-b969ff6ff928 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.161076 Aug 10 22:48:38.933388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 95/191] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:38 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:39.065738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:39.074172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-06e198b1-6d84-4bf5-9c81-8c01da3775f7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.163349 Aug 10 22:48:39.075259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 97/192] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:38 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:39.104734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:39.105374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:39.111228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.111708 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.112141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:39.112817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.113267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.113812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:39.244639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:39.252501 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:39.254046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:39.255804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3aeaa9ab-a55b-4012-a9e7-03ef54b958dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.154950 Aug 10 22:48:39.256356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 96/193] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:39 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:39.334980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:39.335666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:39.342273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.342769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.343192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:39.343878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.344362 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.345156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:39.367427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:39.368258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:39.374750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.375227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.375654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:39.376338 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.376783 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.377199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:39.409085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:39.417250 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a4df17ba-90fb-4ba6-a88e-99e011b7cea1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1215 microversion: 2.1 time: 0.086581 Aug 10 22:48:39.417849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 98/194] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:39 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:39.438195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:39.445790 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6eb71bcf-3cf9-41f4-8f6f-27d4e2ec1ed7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1223 microversion: 2.1 time: 0.084155 Aug 10 22:48:39.446383 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 97/195] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:39 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:39.951165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:39.952083 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:39.965115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.965805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.968147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:39.969170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:39.971983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:39.974199 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.102977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:40.108583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:40.118654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.119559 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.121710 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.122878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.123556 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.124186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.269431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:40.277863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2cb33b98-5f54-4db2-b5e5-c3a3984d334f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.330914 Aug 10 22:48:40.278438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 99/196] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:39 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:40.283734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:40.284500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:40.292717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.293202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.293704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.296232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.296735 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.297164 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.303325 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:40.310713 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d3e5a029-48f3-4f3d-95be-4e86435c8bbe tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.217965 Aug 10 22:48:40.311285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 98/197] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:40 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:40.435376 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:40.443502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:40.444960 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:40.445969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:40.446692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:40.447806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d24436c8-2e45-45b8-910f-5ecb33504e21 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.168466 Aug 10 22:48:40.448358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 100/198] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:40 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:40.452202 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.452686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.453116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.453848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.454292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.454711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.465823 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:40.466425 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:40.472294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.472778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.473211 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.473943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:40.474392 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:40.474811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:40.519380 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:40.526937 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e0d874a3-0afc-4560-a311-db1ea5d56c8a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1263 microversion: 2.1 time: 0.089895 Aug 10 22:48:40.528291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 99/199] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:40 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:40.546079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:40.554404 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0a83e15e-d6ac-4582-a483-4765df39a559 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1271 microversion: 2.1 time: 0.092200 Aug 10 22:48:40.555108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 101/200] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:40 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:41.299043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:41.299645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:41.321197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.321897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.322141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.323007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.323602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.324178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.334386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:41.335197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:41.343703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.344195 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.344634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.345374 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.345848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.346276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.548926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:41.553046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:41.556944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ab435ce8-a218-41eb-a0f6-294117e155bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.228688 Aug 10 22:48:41.557547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 102/201] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:41 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:41.560817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4febf718-5178-4aac-9980-04cc861e528c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.265805 Aug 10 22:48:41.561490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 100/202] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:41 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:41.562094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:41.562758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:41.569216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.571379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.571898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.572517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.572978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.573433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.577535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:41.578162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:41.587091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.587574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.588002 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.588691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.589137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.589616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.593661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:41.672404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:41.680904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-791c1185-6d23-4e5d-9b9e-ce01e3b46dca tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1271 microversion: 2.1 time: 0.118138 Aug 10 22:48:41.681499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 101/203] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:41 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:41.686035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:41.686630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:41.692631 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.693028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.693497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.694193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:41.694646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:41.695064 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:41.748618 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:41.755854 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:41.757480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:41.758888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2494149e-4ba3-4c33-96bc-c2e91bd1de0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.200416 Aug 10 22:48:41.761151 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 103/204] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:41 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:41.763388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:41.776894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0564f791-ec0c-42f8-861f-cca456ba3c71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1279 microversion: 2.1 time: 0.094397 Aug 10 22:48:41.777676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 102/205] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:41 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:42.182962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-4865c3be-4d08-4ae5-8864-73252ff10a42 req-5081ef18-79f3-4a46-9ba5-da152ac611b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cecaf930-d7cc-4ee7-b096-6f206dc50e7a", "name": "network-vif-plugged", "status": "completed", "tag": "fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:42.193101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-4865c3be-4d08-4ae5-8864-73252ff10a42 req-5081ef18-79f3-4a46-9ba5-da152ac611b4 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.193608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-4865c3be-4d08-4ae5-8864-73252ff10a42 req-5081ef18-79f3-4a46-9ba5-da152ac611b4 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.194043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-4865c3be-4d08-4ae5-8864-73252ff10a42 req-5081ef18-79f3-4a46-9ba5-da152ac611b4 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.197992 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:42.206361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-4865c3be-4d08-4ae5-8864-73252ff10a42 req-5081ef18-79f3-4a46-9ba5-da152ac611b4 service nova] Creating event network-vif-plugged:fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d for instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a on hv-cinder-83608 Aug 10 22:48:42.212333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-4865c3be-4d08-4ae5-8864-73252ff10a42 req-5081ef18-79f3-4a46-9ba5-da152ac611b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033255 Aug 10 22:48:42.212946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 104/206] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:42.581739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:42.582304 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:42.588161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:42.589155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:42.591139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.591630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.593622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.595880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.596490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.597750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.607692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.608367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.608886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.612041 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.612602 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.613118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.887521 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:42.895752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a7798fb6-bf15-4987-81c7-6d6ef41361f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.314586 Aug 10 22:48:42.904178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 105/207] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:42 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:42.904486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:42.904607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:42.904607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:42.907328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.907821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.908107 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-93876f3b-9763-47bb-8c98-d5027244b56c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.332458 Aug 10 22:48:42.908283 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.908870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 103/208] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:42 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:42.908999 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.909428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.909849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.914117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:42.914850 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:42.920645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.921244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.921880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.922649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.923177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.923674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.974485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:42.981918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8dcb198d-2834-44ec-a6d3-bdcebbfb8a6c tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1281 microversion: 2.1 time: 0.084610 Aug 10 22:48:42.982484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 106/209] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:42 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:42.986846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:42.987644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:42.993799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.994275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.994699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:42.995556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:42.996013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:42.996920 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:43.069011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:43.076367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a4aa9cdb-5c3e-4611-aaeb-612909148a44 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1277 microversion: 2.1 time: 0.092944 Aug 10 22:48:43.076936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 107/210] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:42 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:43.099823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:43.107637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:43.109134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:43.110262 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-04abf0ef-3f87-4277-9f58-5310c7642f84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1404 microversion: 2.20 time: 0.200137 Aug 10 22:48:43.110802 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 104/211] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:42 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1404 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:43.919336 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:43.920428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:43.929098 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:43.929532 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:43.930466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:43.930895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:43.931454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:43.932785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:43.935473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:43.936804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:43.946169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:43.947038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:43.948817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:43.949816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:43.950438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:43.951042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.286361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:44.291007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:44.296769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9ad8f29c-b556-4e3b-9b25-683c09dd9c88 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.370615 Aug 10 22:48:44.298184 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 105/212] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:43 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:44.304046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c78a7743-0d49-4037-a752-aad9fa3ebeee tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.388535 Aug 10 22:48:44.304915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:44.305811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:44.312572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.313091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.313811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.314754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.315209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.315630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.322726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 108/213] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:43 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:44.329657 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:44.330575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:44.342297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.343652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.344357 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.345652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.346322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.346938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.481473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:44.489669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f43d1fb0-ce9f-4a99-998a-9f58a241ec20 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1277 microversion: 2.1 time: 0.165467 Aug 10 22:48:44.504667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 109/214] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:44 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:44.510060 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:44.510774 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:44.517195 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.517834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.518360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.519146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.520503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.521256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.664227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:44.673320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c5087823-41a9-44df-ac18-d4533e7aa300 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.373750 Aug 10 22:48:44.674959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 106/215] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:44 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:44.680457 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-cc28344c-2528-4b93-98de-7688a1fa5b3c req-decf449e-2d4c-4d8b-a740-80d330784799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b5a255-e068-46e0-8c6d-bdde4a91c933", "name": "network-vif-plugged", "status": "completed", "tag": "9c856112-b712-4ce2-941b-5d426ef1738d"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:44.692649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-cc28344c-2528-4b93-98de-7688a1fa5b3c req-decf449e-2d4c-4d8b-a740-80d330784799 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.693574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-cc28344c-2528-4b93-98de-7688a1fa5b3c req-decf449e-2d4c-4d8b-a740-80d330784799 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.694009 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-cc28344c-2528-4b93-98de-7688a1fa5b3c req-decf449e-2d4c-4d8b-a740-80d330784799 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.707033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-cc28344c-2528-4b93-98de-7688a1fa5b3c req-decf449e-2d4c-4d8b-a740-80d330784799 service nova] Creating event network-vif-plugged:9c856112-b712-4ce2-941b-5d426ef1738d for instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 on hv-cinder-83608 Aug 10 22:48:44.712906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-cc28344c-2528-4b93-98de-7688a1fa5b3c req-decf449e-2d4c-4d8b-a740-80d330784799 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036635 Aug 10 22:48:44.713561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 107/216] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:44.760302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:44.768613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:44.770731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:44.771879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-375db718-2df6-4b47-bfef-4ba82bc92092 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1595 microversion: 2.20 time: 0.266236 Aug 10 22:48:44.772626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 110/217] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:48:44 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1595 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:44.803984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:44.804568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:44.811915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.812404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.812845 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:44.813921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:44.814648 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:44.815403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.039269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e8e51e33-69e8-481e-847f-745c99e910f2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.245822 Aug 10 22:48:45.040155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 108/218] 10.222.0.76 () {60 vars in 1316 bytes} [Wed Aug 10 22:48:44 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:48:45.319849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:45.321105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:45.328013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.328795 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.329400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.330259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.330853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.331412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.336798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:45.338177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:45.346806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.347997 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.349371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.352723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.353258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.353892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.802624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:45.811055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-747c6bc9-ac9e-4cfd-be5f-4784ba5a31ab tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.483509 Aug 10 22:48:45.811719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 109/219] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:45 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:45.823153 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:45.824170 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:45.831782 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.832969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.833772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.834573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.835126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.835652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.857851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:45.867202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-47ffe2cd-e180-4500-a395-0a5628891a38 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.551789 Aug 10 22:48:45.868375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 111/220] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:45 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:45.873231 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-945bc2a4-7665-4165-8e61-937a9cfa52fd req-e844e5b9-e284-4df7-8846-52ac40c061f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4edeaacb-3fb5-4dff-8e69-2b35d58fbad0", "tag": "778467ad-ffb4-4238-89cb-87ab191cb39e"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:45.886424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-945bc2a4-7665-4165-8e61-937a9cfa52fd req-e844e5b9-e284-4df7-8846-52ac40c061f2 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.886874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-945bc2a4-7665-4165-8e61-937a9cfa52fd req-e844e5b9-e284-4df7-8846-52ac40c061f2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.887502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-945bc2a4-7665-4165-8e61-937a9cfa52fd req-e844e5b9-e284-4df7-8846-52ac40c061f2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.899324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-945bc2a4-7665-4165-8e61-937a9cfa52fd req-e844e5b9-e284-4df7-8846-52ac40c061f2 service nova] Creating event network-changed:778467ad-ffb4-4238-89cb-87ab191cb39e for instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 on hv-cinder-83608 Aug 10 22:48:45.904288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-945bc2a4-7665-4165-8e61-937a9cfa52fd req-e844e5b9-e284-4df7-8846-52ac40c061f2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034659 Aug 10 22:48:45.904893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 112/221] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:45.910635 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:45.911740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:45.917910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.918409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.918852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:45.919560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:45.920021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:45.920446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:46.400898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:46.421441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-66620d09-f593-46a7-9339-f670cee8fc06 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.608535 Aug 10 22:48:46.434819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 110/222] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:45 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:46.503182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:46.516133 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-706c867e-fb7b-4538-b8f4-d9c199c97644 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.609847 Aug 10 22:48:46.517463 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 113/223] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:45 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:46.784065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-dddb94bb-9957-48a5-8fb5-86f6ee87f3d6 req-14746373-90ed-4143-9440-06796755a121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ea59d8-9100-4f06-a66a-fbd5cb617a45", "tag": "5a349922-1225-4f59-a0fd-ba4359143870"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:46.793565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-dddb94bb-9957-48a5-8fb5-86f6ee87f3d6 req-14746373-90ed-4143-9440-06796755a121 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:46.794044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-dddb94bb-9957-48a5-8fb5-86f6ee87f3d6 req-14746373-90ed-4143-9440-06796755a121 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:46.794503 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-dddb94bb-9957-48a5-8fb5-86f6ee87f3d6 req-14746373-90ed-4143-9440-06796755a121 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:46.807620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-dddb94bb-9957-48a5-8fb5-86f6ee87f3d6 req-14746373-90ed-4143-9440-06796755a121 service nova] Creating event network-changed:5a349922-1225-4f59-a0fd-ba4359143870 for instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 on hv-cinder-83608 Aug 10 22:48:46.814294 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-dddb94bb-9957-48a5-8fb5-86f6ee87f3d6 req-14746373-90ed-4143-9440-06796755a121 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Aug 10 22:48:46.814895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 111/224] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:46.833155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:46.833836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:46.840246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:46.840829 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:46.841405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:46.842230 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:46.842756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:46.843260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:46.894347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:46.895844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:46.902510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:46.903180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:46.903724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:46.904497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:46.904982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:46.905432 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:47.344538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:47.350638 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:47.352887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-65326096-98db-402d-9ec5-2bca715ecc98 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1367 microversion: 2.1 time: 0.524588 Aug 10 22:48:47.353502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 114/225] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:46 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:47.360993 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-17e968ea-f848-4f26-b315-608fa1503ba9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.472150 Aug 10 22:48:47.361778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 112/226] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:46 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:47.444681 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:47.445679 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:47.452264 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:47.453072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:47.453791 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:47.454872 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:47.455534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:47.456281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:47.539038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:47.539716 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:47.547565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:47.548228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:47.549235 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:47.551063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:47.551522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:47.552215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:47.732669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:47.742814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f4d11caa-bc5b-48a8-bc97-e3009a3baf39 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.302644 Aug 10 22:48:47.754592 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 115/227] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:47 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:47.766378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:47.776182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8f4ba1b0-3485-4328-9e46-990b7fc7dbe6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.241895 Aug 10 22:48:47.778199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 113/228] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:47 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:48.374489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:48.375095 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:48.382197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.382696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.383142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.383558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:48.383846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.384299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.384417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:48.384724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.391109 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.391835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.392453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.393148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.393630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.394046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.603419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:48.606250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:48.611871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6481c8f3-974d-4ed0-a854-d9508489c98b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1556 microversion: 2.1 time: 0.241215 Aug 10 22:48:48.613888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-713a6608-6fa8-4c18-b335-a17a6e90a5fa tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.234816 Aug 10 22:48:48.614633 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 114/229] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:48 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:48.615886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 116/230] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:48 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:48.635889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:48.636411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:48.642389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.642868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.643296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.643987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.645024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.645494 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.726701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8777c54f-3982-4305-8303-af9ea7a35d6c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094576 Aug 10 22:48:48.727288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 115/231] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:48:48 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:48:48.765452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:48.766066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:48.772749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.773552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.774024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.774731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.775178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.775762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.797665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:48.798272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:48.808019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.808511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.808947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:48.809669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:48.810117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:48.810541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:49.261158 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:49.268909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5e4b3554-47e0-4b35-9fd4-aa236ad254ee tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.507491 Aug 10 22:48:49.270950 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 117/232] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:48 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:49.281721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-d769bf16-4409-4b69-be56-241b943c523f req-a4769264-fd0d-4508-a074-77775b46e1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0", "tag": "1090c7bb-79eb-4915-b7e9-12cdfafe465a"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:49.294333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-d769bf16-4409-4b69-be56-241b943c523f req-a4769264-fd0d-4508-a074-77775b46e1c6 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:49.294816 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-d769bf16-4409-4b69-be56-241b943c523f req-a4769264-fd0d-4508-a074-77775b46e1c6 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:49.295402 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-d769bf16-4409-4b69-be56-241b943c523f req-a4769264-fd0d-4508-a074-77775b46e1c6 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:49.300836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:49.309889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2c977ce5-0cec-4f34-9c39-61faf1826b20 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.515957 Aug 10 22:48:49.310180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-d769bf16-4409-4b69-be56-241b943c523f req-a4769264-fd0d-4508-a074-77775b46e1c6 service nova] Creating event network-changed:1090c7bb-79eb-4915-b7e9-12cdfafe465a for instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 on hv-cinder-83608 Aug 10 22:48:49.321305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 116/233] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:48 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:49.323896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-d769bf16-4409-4b69-be56-241b943c523f req-a4769264-fd0d-4508-a074-77775b46e1c6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050999 Aug 10 22:48:49.324450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 118/234] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:49.635205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:49.635941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:49.641883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:49.642368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:49.642804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:49.643495 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:49.643948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:49.645107 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:49.859521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:49.867120 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8cc8c2a1-dcb7-4cb1-835f-831d494e2297 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.235731 Aug 10 22:48:49.867696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 117/235] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:49 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:50.297818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:50.298533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:50.305640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:50.306123 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:50.306551 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:50.307229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:50.307674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:50.308102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:50.331978 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:50.332958 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:50.339772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:50.339877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:50.340241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:50.341142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:50.342128 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:50.342737 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:50.499930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:50.509024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-06368f2f-33a3-48e1-b116-1e13e7631344 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.215821 Aug 10 22:48:50.509752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 119/236] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:50 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:50.534142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:50.541824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-358552a8-65b8-470c-9ec2-236aece19be2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.213719 Aug 10 22:48:50.542414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 118/237] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:50 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:50.888393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:50.889112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:50.896289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:50.896790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:50.897233 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:50.897969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:50.898428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:50.898856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:51.040124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:51.047834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a62b2bb7-3f58-4e9b-aba1-033408a27378 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.163304 Aug 10 22:48:51.048637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 120/238] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:50 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:51.359973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-298bb742-be13-440b-a4a3-7382f8526c29 req-9e33c060-aaae-4d6b-ba13-0aa89414edf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cecaf930-d7cc-4ee7-b096-6f206dc50e7a", "tag": "fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:51.369523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-298bb742-be13-440b-a4a3-7382f8526c29 req-9e33c060-aaae-4d6b-ba13-0aa89414edf5 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:51.369990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-298bb742-be13-440b-a4a3-7382f8526c29 req-9e33c060-aaae-4d6b-ba13-0aa89414edf5 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:51.370418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-298bb742-be13-440b-a4a3-7382f8526c29 req-9e33c060-aaae-4d6b-ba13-0aa89414edf5 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:51.381888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-298bb742-be13-440b-a4a3-7382f8526c29 req-9e33c060-aaae-4d6b-ba13-0aa89414edf5 service nova] Creating event network-changed:fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d for instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a on hv-cinder-83608 Aug 10 22:48:51.386894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-298bb742-be13-440b-a4a3-7382f8526c29 req-9e33c060-aaae-4d6b-ba13-0aa89414edf5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030622 Aug 10 22:48:51.387465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 119/239] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:51.530919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:51.531543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:51.534979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:51.539100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:51.539577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:51.540002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:51.540676 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:51.541126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:51.541565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:51.563234 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:51.563858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:51.570796 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:51.571288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:51.571723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:51.572414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:51.572871 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:51.573318 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:51.591132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:51.728103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:51.735619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-40c4dd2a-0651-49ad-be68-1adc3cf58c0a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.208549 Aug 10 22:48:51.736289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 121/240] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:51 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:51.750556 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:51.758798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2a722b36-e791-4a79-9547-320d8c1592fd tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.199759 Aug 10 22:48:51.759358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 120/241] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:51 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:52.069265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:52.069902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:52.075814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:52.076290 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:52.076720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:52.077470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:52.077997 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:52.078410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:52.210998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:52.214360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:52.219130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-178063c3-24fe-413f-a843-a57ec2f37ec4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.153759 Aug 10 22:48:52.219698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 122/242] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:52 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:52.757533 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:52.758208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:52.764176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:52.764654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:52.765085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:52.765786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:52.766240 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:52.766656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:52.779044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:52.779649 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:52.786864 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:52.787346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:52.787779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:52.788477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:52.788925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:52.789369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:52.967215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:52.970546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:52.974859 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-dfc95bee-08ed-4613-b720-0bf080a44fb8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.221684 Aug 10 22:48:52.975520 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 121/243] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:52 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:52.978377 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-76046573-4381-40fe-9793-e5c5ca02422b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.203092 Aug 10 22:48:52.978942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 123/244] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:52 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:53.240530 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:53.241140 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:53.247165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:53.247644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:53.248081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:53.248766 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:53.249222 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:53.249670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:53.377442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:53.385766 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c08e7250-bfb9-42ff-ad9c-3213eefb34eb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.149737 Aug 10 22:48:53.386275 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 122/245] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:53 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:53.995597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:53.996109 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:53.998315 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:53.998926 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:54.002539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:54.003014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:54.003648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:54.004386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:54.004843 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:54.005356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:54.005748 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:54.006247 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:54.006690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:54.007392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:54.007852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:54.008277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:54.405846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:54.410328 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:54.414288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d2d365a4-3183-4928-af7d-85a381669d94 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.422784 Aug 10 22:48:54.421077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 124/246] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:53 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:54.421077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:54.421077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:54.424257 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-42f9ce04-2dbb-4943-a6bc-1c87e27a701b tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.429578 Aug 10 22:48:54.424927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 123/247] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:53 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:48:54.428617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:54.429112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:54.429575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:54.430283 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:54.430741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:54.431167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:54.567631 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:54.575215 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2e3c5321-577c-462c-8f43-9c25fffbad63 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1362 microversion: 2.1 time: 0.158881 Aug 10 22:48:54.575779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 125/248] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:54 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:55.436707 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:55.437680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:55.446984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.446984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.448955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:55.449708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:55.450182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.450182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.450621 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:55.451155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:55.459548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.460170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.460707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:55.461525 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.462221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.462856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:55.690246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:55.696136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:55.703255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1e1ffa29-a197-4635-b33b-f5cdb0d41709 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.269726 Aug 10 22:48:55.704680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 124/249] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:55 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:55.712173 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:55.713049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:55.717730 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-18a403fa-3565-4941-9f9e-7b60348d0942 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.263396 Aug 10 22:48:55.718655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 126/250] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:55 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:55.727246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.727821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.728324 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:55.729132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.729676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.730167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:55.919332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:55.935970 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0297e40e-303e-4c9b-b122-d4cf57d05250 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1548 microversion: 2.1 time: 0.229395 Aug 10 22:48:55.936592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 125/251] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:55 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:55.959210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:55.959642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:55.965760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.966273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.967254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:55.968144 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:55.968598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:55.969019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:56.058118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-32e89283-74f9-401f-8ffd-ed9e4345d746 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103328 Aug 10 22:48:56.058756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 127/252] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:48:55 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:56.725117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:56.725911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:56.732126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:56.734846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:56.735325 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:56.736131 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:56.736636 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:56.737270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:56.745003 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:56.747113 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:56.766744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:56.767913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:56.769412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:56.770996 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:56.771994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:56.772980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:57.015932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:57.032416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:57.043493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-05c2a3ad-5245-4d6f-b565-ea8cd18eaf3d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.306925 Aug 10 22:48:57.045705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 128/253] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:56 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:57.047842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0a4a6e36-4e0c-4514-bc90-c28b148266e5 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.327621 Aug 10 22:48:57.048603 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 126/254] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:56 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:57.642992 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-ed12436c-92c5-43c6-aedc-2f279de8c4cd req-3546b31f-c60f-4335-b20a-7b589821d883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b5a255-e068-46e0-8c6d-bdde4a91c933", "tag": "9c856112-b712-4ce2-941b-5d426ef1738d"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:48:57.653582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ed12436c-92c5-43c6-aedc-2f279de8c4cd req-3546b31f-c60f-4335-b20a-7b589821d883 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:57.654467 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ed12436c-92c5-43c6-aedc-2f279de8c4cd req-3546b31f-c60f-4335-b20a-7b589821d883 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:57.655068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ed12436c-92c5-43c6-aedc-2f279de8c4cd req-3546b31f-c60f-4335-b20a-7b589821d883 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:57.668556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-ed12436c-92c5-43c6-aedc-2f279de8c4cd req-3546b31f-c60f-4335-b20a-7b589821d883 service nova] Creating event network-changed:9c856112-b712-4ce2-941b-5d426ef1738d for instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 on hv-cinder-83608 Aug 10 22:48:57.674073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-ed12436c-92c5-43c6-aedc-2f279de8c4cd req-3546b31f-c60f-4335-b20a-7b589821d883 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034525 Aug 10 22:48:57.675772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 129/255] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:58.066930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:58.068126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:58.073693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:58.074563 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:58.074751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:58.075414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:58.075856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:58.076761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:58.077222 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:58.077682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:58.082797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:58.083873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:58.084647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:58.085520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:58.086643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:58.089576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:58.279175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:58.292059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b72fe782-62b3-4400-b061-087fa5a88ce3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.229635 Aug 10 22:48:58.305313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 127/256] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:58 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:58.305694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:58.317531 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ed04b795-ac50-4ec4-a4f1-4af7d0aefd33 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.247761 Aug 10 22:48:58.318261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 130/257] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:58 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:59.314730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:59.315330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:59.317858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:59.322911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:59.323383 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:59.323811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:59.324579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:59.325029 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:59.325780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:59.339831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:59.341071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:48:59.349896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:59.350819 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:59.351355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:59.352720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:48:59.353415 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:48:59.353932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:48:59.532226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:59.540181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:48:59.540615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c465ab92-99fc-4beb-970d-6dde93422f37 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.229584 Aug 10 22:48:59.541196 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 128/258] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:59 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:59.547622 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fb9b5e19-7f3b-41a2-b6b6-147c2517162f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.213517 Aug 10 22:48:59.548180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 131/259] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:48:59 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:00.561698 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:00.562298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:00.568812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:00.569446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:00.569592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:00.570085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:00.570553 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:00.571248 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:00.571699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:00.572123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:00.575796 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:00.576281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:00.576716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:00.577448 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:00.577900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:00.578322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:00.762409 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:00.769930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-dbbbdfa0-d91d-4286-bad7-995cd5d463c8 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.211881 Aug 10 22:49:00.770502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 129/260] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:00 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:00.770660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:00.778193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b39a075c-c16d-4d8b-a95d-4d6b1d0b5c1f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.214364 Aug 10 22:49:00.778841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 132/261] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:00 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:01.789739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:01.790264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:01.796282 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:01.796760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:01.797187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:01.797895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:01.798250 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:01.798669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:01.798877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:01.798969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:01.805817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:01.806299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:01.806727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:01.807476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:01.807869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:01.808292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:01.997693 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:02.001141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:02.005985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-163bbdf0-e819-451d-82a6-6d9641650dc3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.220147 Aug 10 22:49:02.006565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 130/262] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:01 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:02.009029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c845a17f-aa47-4d98-9735-e4813591d742 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.214521 Aug 10 22:49:02.009630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 133/263] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:01 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:03.028206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:03.028919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:03.029955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:03.030569 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:03.036093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:03.036585 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:03.037018 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:03.037746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:03.037922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:03.038202 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:03.038409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:03.038629 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:03.038936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:03.039624 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:03.040077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:03.040501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:03.236469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:03.240661 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:03.244043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-47e295bf-604d-43c5-b1be-8a74b4af5a29 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.220002 Aug 10 22:49:03.244619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 131/264] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:03 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:03.248495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-312c0179-4761-45b6-9c65-b7c8b489852c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.222307 Aug 10 22:49:03.249096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 134/265] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:03 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:04.264910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:04.265498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:04.270804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:04.271420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:04.271960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:04.272448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:04.272960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:04.273585 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:04.274032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:04.274453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:04.277765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:04.278261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:04.278701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:04.279400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:04.279868 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:04.280294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:04.505946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:04.509268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:04.513696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-65317a99-4c41-4d7d-a52a-2a6caa2d2143 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.252777 Aug 10 22:49:04.514781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 132/266] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:04 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:04.516824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-39c9a71b-9f68-460a-b9ed-8c7a6cabcbd7 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.250898 Aug 10 22:49:04.517351 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 135/267] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:04 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:05.546840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:05.546840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:05.546840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:05.546840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:05.547523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:05.547523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:05.547523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:05.547523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:05.551804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:05.552878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:05.560236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:05.560967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:05.561593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:05.562438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:05.563030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:05.563594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:05.756136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:05.770854 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8b746373-3f27-4f7f-a363-c5bbfeeb4a18 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.238920 Aug 10 22:49:05.772138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 133/268] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:05 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:05.774137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:05.782173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f963daf1-2d1f-41e4-b03c-77f8db86c713 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.248633 Aug 10 22:49:05.782755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 136/269] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:05 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:06.793787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:06.798135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:06.805055 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:06.805711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:06.814277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:06.814765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:06.817381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:06.818269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:06.821142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:06.822668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:06.823702 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:06.824006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:06.824857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:06.825582 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:06.825889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:06.829510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:07.496194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:07.506630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2b00c7d2-04e3-48ad-b376-990fd9bfafb0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.718224 Aug 10 22:49:07.521032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:07.525382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 134/270] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:06 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:07.526745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5453b6ba-fad9-40fa-a9b8-b02c3f276a80 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.726152 Aug 10 22:49:07.527534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 137/271] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:06 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:07.534445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:07.534445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:07.543463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:07.544108 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:07.544548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:07.545268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:07.545744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:07.546165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:07.579422 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:49:07.695762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:07.776230 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b96c7ece-4342-489a-bab8-f547a0b4e8e7 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 204 len: 0 microversion: 2.1 time: 0.249110 Aug 10 22:49:07.777626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 135/272] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:49:07 2022] DELETE /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:49:07.787215 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:07.788028 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:07.796476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:07.797609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:07.798206 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:07.799373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:07.800078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:07.800943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:07.959905 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:07.970244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bd33c6d2-3f24-4d3a-abb2-6f157d797058 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.187656 Aug 10 22:49:07.970845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 138/273] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:07 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:08.500998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-d56fd433-77ab-4528-81e0-0aa5c33fa8a8 req-e62bfbdb-7a9e-4124-b96a-1b89f21537fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edeaacb-3fb5-4dff-8e69-2b35d58fbad0", "name": "network-vif-plugged", "status": "completed", "tag": "778467ad-ffb4-4238-89cb-87ab191cb39e"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:08.513814 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d56fd433-77ab-4528-81e0-0aa5c33fa8a8 req-e62bfbdb-7a9e-4124-b96a-1b89f21537fc service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:08.514389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d56fd433-77ab-4528-81e0-0aa5c33fa8a8 req-e62bfbdb-7a9e-4124-b96a-1b89f21537fc service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:08.514865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d56fd433-77ab-4528-81e0-0aa5c33fa8a8 req-e62bfbdb-7a9e-4124-b96a-1b89f21537fc service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:08.528408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:08.529069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:08.539235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:08.539935 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:08.540446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:08.542144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-d56fd433-77ab-4528-81e0-0aa5c33fa8a8 req-e62bfbdb-7a9e-4124-b96a-1b89f21537fc service nova] Creating event network-vif-plugged:778467ad-ffb4-4238-89cb-87ab191cb39e for instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 on hv-cinder-83608 Aug 10 22:49:08.542608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:08.543078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:08.543502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:08.557558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-d56fd433-77ab-4528-81e0-0aa5c33fa8a8 req-e62bfbdb-7a9e-4124-b96a-1b89f21537fc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062717 Aug 10 22:49:08.558169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 136/274] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:08.565270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:08.566622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:08.573424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:08.574140 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:08.574730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:08.575620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:08.576277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:08.576883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:08.752283 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:08.762146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c0d7acac-e90d-439b-bb67-db53d9f099bc tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.237941 Aug 10 22:49:08.773513 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 139/275] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:08 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:08.795089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:08.804323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fbd1e91b-d9ac-4421-9394-29ca0f82424c tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.243623 Aug 10 22:49:08.805073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 137/276] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:08 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:08.993419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:08.993975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:09.001103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:09.001623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:09.002071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:09.003666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:09.004319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:09.004754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:09.022987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:09.143335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:09.152210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-887fd397-8b2b-4a32-ad24-b2d3cc72c80a tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.163821 Aug 10 22:49:09.152813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 140/277] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:08 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:09.784480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:09.785126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:09.791373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:09.791849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:09.792285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:09.792965 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:09.793445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:09.793866 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:09.829569 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:09.830185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:09.840516 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:09.841579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:09.842020 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:09.842717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:09.843168 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:09.843590 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:10.014163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:10.022689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5fb2387b-0e96-407a-af28-2d297c15c3ac tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.242556 Aug 10 22:49:10.023295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 138/278] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:09 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:10.042161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:10.049565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-700798f2-b9a1-4061-a2fc-8e77da8e9076 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.224061 Aug 10 22:49:10.050161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 141/279] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:09 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:10.173516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:10.174147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:10.180407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:10.180887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:10.181341 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:10.182026 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:10.182477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:10.182900 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:10.312785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:10.321713 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-00a57d05-d3fb-46d4-a2d1-6813ad499a49 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.151979 Aug 10 22:49:10.322283 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 139/280] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:10 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:11.045240 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:11.045905 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:11.053257 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:11.054058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:11.054491 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:11.055214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:11.055662 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:11.056080 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:11.071692 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:11.072256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:11.078751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:11.079613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:11.080084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:11.080841 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:11.081323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:11.082393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:11.269855 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:11.277606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-34e5a767-b24b-4f67-b767-b852bf9eb622 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.237746 Aug 10 22:49:11.278121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 142/281] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:11 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:11.285910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:11.297665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9d2338da-625f-4f89-9d53-47888a702b63 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.229674 Aug 10 22:49:11.298241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 140/282] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:11 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:11.351901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:11.352574 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:11.358854 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:11.359348 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:11.359839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:11.360546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:11.361067 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:11.361449 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:11.501674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:11.510249 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c0955f58-fe98-4b3d-8a3e-214fcccf4976 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.171736 Aug 10 22:49:11.510826 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 143/283] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:11 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:12.297857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:12.298460 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:12.305468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:12.305945 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:12.306374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:12.307051 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:12.307497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:12.307908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:12.318530 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:12.319141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:12.325762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:12.326315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:12.326747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:12.327432 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:12.327913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:12.328329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:12.494428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:12.502868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9f828130-8bcb-4f3c-bd91-0d4df1a5c3ec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.208763 Aug 10 22:49:12.515909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 141/284] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:12 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:12.520186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:12.527686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-04b3498e-0ce4-42a2-8c1e-28241db8cfa3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.213028 Aug 10 22:49:12.528240 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 144/285] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:12 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:12.535834 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:12.536445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:12.542291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:12.542776 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:12.543212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:12.543900 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:12.544353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:12.544777 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:12.673745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:12.682011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4d1978d4-2347-4cfc-8aa3-60b0111241fc tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.150563 Aug 10 22:49:12.682580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 142/286] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:12 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:13.523431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:13.524033 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:13.530414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:13.530897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:13.531327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:13.532010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:13.532457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:13.532874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:13.547953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:13.548780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:13.556517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:13.557110 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:13.557645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:13.558421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:13.559028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:13.559467 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:13.736034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:13.741069 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:13.744630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e31260ea-18b3-4c26-8154-11e1af6a9bec tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.225163 Aug 10 22:49:13.745210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 145/287] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:13 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:13.749590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-07fdbc16-99ae-42dc-9f67-c5be83160eac tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.205405 Aug 10 22:49:13.749742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:13.750306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:13.750568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 143/288] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:13 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:13.756995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:13.757710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:13.758150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:13.758874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:13.759323 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:13.759745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:13.886743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:13.894678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d4fbaea9-91dc-4915-b8d6-72805b59f932 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.148449 Aug 10 22:49:13.895241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 146/289] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:13 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:14.764536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:14.765153 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:14.771123 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:14.771869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:14.773091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:14.773620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:14.774059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:14.774773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:14.775217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:14.775638 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:14.778485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:14.778981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:14.779421 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:14.780122 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:14.780579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:14.781002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:14.989825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:14.993652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:14.997248 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-09a82fe2-de0f-4b0a-9458-ab579180654d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.236511 Aug 10 22:49:14.997843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 144/290] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:14 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:15.002322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:15.003150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:15.003874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-18daac0e-74d4-4791-b84e-8029a2573c8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.237024 Aug 10 22:49:15.004535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 147/291] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:14 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:15.009110 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:15.009622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:15.010086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:15.010783 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:15.011231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:15.011650 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:15.146352 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:15.154291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-22cad98d-46b3-4d17-9e5e-b001c1d8d3cf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.155516 Aug 10 22:49:15.154860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 145/292] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:14 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:16.019469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:16.019987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:16.024432 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:16.025046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:16.026600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:16.027106 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:16.027523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:16.028220 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:16.028675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:16.029102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:16.031106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:16.031590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:16.032030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:16.032719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:16.033181 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:16.033634 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:16.222399 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:16.226407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:16.230234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-49b52146-991a-4a99-87e5-e84e7001825a tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.215608 Aug 10 22:49:16.230827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 148/293] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:16 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:16.234302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3e889b8c-157e-4cb8-bc00-f47fd38bcb37 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.213538 Aug 10 22:49:16.234867 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 146/294] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:16 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:16.235256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:16.235854 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:16.244542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:16.247325 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:16.247780 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:16.248630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:16.249252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:16.250053 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:16.391865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:16.400054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b4a0da61-8a7a-41fe-847e-25dfc11e17e5 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.168284 Aug 10 22:49:16.400608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 149/295] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:16 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:17.251607 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:17.252942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:17.261212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:17.261846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:17.262260 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:17.264139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:17.264617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:17.265345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:17.267082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:17.268318 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:17.275516 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:17.276015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:17.276454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:17.277160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:17.277648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:17.278069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:17.487579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:17.491121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:17.495407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-972400ca-2cb8-498d-8040-809952f025a2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.248435 Aug 10 22:49:17.496048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 147/296] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:17 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:17.498786 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f3d05e4f-2b54-4e6d-8729-fc7b64f1ab8d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.244632 Aug 10 22:49:17.499339 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 150/297] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:17 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:17.500526 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:17.501186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:17.507683 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:17.508165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:17.508876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:17.509833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:17.510370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:17.510852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:17.644447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:17.652604 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-95596133-fdbf-44b1-b756-b71623335ddf tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.155535 Aug 10 22:49:17.653178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 148/298] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:17 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:18.520029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:18.520951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:18.523607 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:18.524508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:18.527819 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:18.528598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:18.529111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:18.530004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:18.530466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:18.531061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:18.532924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:18.533660 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:18.534200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:18.535190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:18.535944 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:18.536560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:18.698277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:18.705980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-acf4bc82-fe16-4b17-b7de-205440096e5a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.189870 Aug 10 22:49:18.706549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 149/299] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:18 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:18.711560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:18.712162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:18.718219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:18.718700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:18.719129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:18.719811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:18.720254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:18.720870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:18.860239 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:18.868147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e4f5dbd1-6edb-471c-8ce5-19eafb8116c1 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.353377 Aug 10 22:49:18.868724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 151/300] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:18 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:18.886638 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:18.895005 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7997476f-cc6f-4aac-9f74-42db719d5635 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1554 microversion: 2.1 time: 0.187452 Aug 10 22:49:18.895516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 150/301] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:18 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:19.483847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-78f4d9a9-9ad3-430e-aeef-267c9bcf724e req-8de4a267-14f5-40ba-9734-a14a64c5b3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5", "name": "network-vif-deleted", "tag": "241ce478-addd-4d55-a11c-efd8025f509c"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:19.495177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-78f4d9a9-9ad3-430e-aeef-267c9bcf724e req-8de4a267-14f5-40ba-9734-a14a64c5b3d8 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:19.495650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-78f4d9a9-9ad3-430e-aeef-267c9bcf724e req-8de4a267-14f5-40ba-9734-a14a64c5b3d8 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:19.496074 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-78f4d9a9-9ad3-430e-aeef-267c9bcf724e req-8de4a267-14f5-40ba-9734-a14a64c5b3d8 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:19.508306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-78f4d9a9-9ad3-430e-aeef-267c9bcf724e req-8de4a267-14f5-40ba-9734-a14a64c5b3d8 service nova] Creating event network-vif-deleted:241ce478-addd-4d55-a11c-efd8025f509c for instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 on hv-cinder-83608 Aug 10 22:49:19.514346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-78f4d9a9-9ad3-430e-aeef-267c9bcf724e req-8de4a267-14f5-40ba-9734-a14a64c5b3d8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034021 Aug 10 22:49:19.524627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 152/302] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:19.727190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:19.727757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:19.734068 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:19.734560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:19.734994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:19.735697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:19.736884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:19.737673 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:19.880960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:19.890693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:19.891413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:19.899071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:19.899266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:19.899905 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:19.900799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:19.901491 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:19.902119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:19.908350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a6a6dcf4-bd35-47e2-83a6-8a4561f34462 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.184335 Aug 10 22:49:19.910459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 151/303] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:19 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:19.916796 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:19.917835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:19.926549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:19.927124 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:19.927573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:19.928310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:19.928855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:19.929249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:20.021407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:20.025152 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:20.030755 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b5cb0907-dd02-4093-9e4f-75f28354e0c4 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1512 microversion: 2.1 time: 0.119070 Aug 10 22:49:20.031345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 152/304] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:19 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1512 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:20.086642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:20.098611 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-719e3228-b1db-41c9-8ed8-ca0a18727616 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.212979 Aug 10 22:49:20.111290 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 153/305] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:19 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:20.930885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:20.931487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:20.939186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:20.939186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:20.939588 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:20.940286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:20.940732 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:20.941147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:21.052179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:21.052788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:21.059094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:21.059585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:21.060025 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:21.060735 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:21.061191 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:21.061654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:21.076482 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:21.084387 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bca2dd30-9cef-4ed0-8e62-123b48170655 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1319 microversion: 2.1 time: 0.157332 Aug 10 22:49:21.084982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 153/306] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:20 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:21.093489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:21.093973 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:21.094405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:21.094862 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lazy-loading 'fault' on Instance uuid 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:49:21.119555 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:21.120169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:21.126205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:21.127236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:21.127667 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:21.128511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:21.129457 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:21.129879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:21.143242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:21.152149 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1246aa75-e013-4354-84f0-b40d2db59eec tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1351 microversion: 2.1 time: 0.104194 Aug 10 22:49:21.152708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 154/307] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:21 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:21.267662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:21.275310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-04f647e3-3b72-46e9-afb3-7a631ce297a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.160280 Aug 10 22:49:21.275885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 154/308] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:21 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:22.106624 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:22.107169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:22.109609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=69 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:22.116242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:22.116728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:22.117162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:22.117886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:22.118342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:22.118770 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:22.176554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:22.177441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:22.184623 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:22.185355 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:22.185799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:22.186643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:22.187240 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:22.187663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:22.221471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:22.222499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:22.222936 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:22.223508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lazy-loading 'fault' on Instance uuid 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:49:22.270617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:22.278620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e46b211c-a6fe-468c-8550-4fc654d100a0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1509 microversion: 2.1 time: 0.175852 Aug 10 22:49:22.279523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 155/309] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:22 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:22.287499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4dc87fae144ab9a40e1f047330168d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaae1e0f2ab8493cb12abbaf01f1833a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:22.297055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8ef88aec-136a-4319-8aed-5eb1b07bc247 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 200 len: 1351 microversion: 2.1 time: 0.124610 Aug 10 22:49:22.297840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 155/310] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:22 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:22.303640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:22.304256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:22.313403 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:22.314200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:22.315091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:22.315968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:22.316554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:22.317259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:22.496913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:22.516190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c7b2aec6-c8c2-486f-8a1c-dbea387bc452 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.219909 Aug 10 22:49:22.518097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 156/311] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:22 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:22.991194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-b193e097-8f19-46ec-8d0f-fae2f5c9ecf5 req-7086e9d5-cb1c-4984-8d32-f6763edd5e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ea59d8-9100-4f06-a66a-fbd5cb617a45", "name": "network-vif-plugged", "status": "completed", "tag": "5a349922-1225-4f59-a0fd-ba4359143870"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:23.008714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b193e097-8f19-46ec-8d0f-fae2f5c9ecf5 req-7086e9d5-cb1c-4984-8d32-f6763edd5e14 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:23.009194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b193e097-8f19-46ec-8d0f-fae2f5c9ecf5 req-7086e9d5-cb1c-4984-8d32-f6763edd5e14 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:23.014044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b193e097-8f19-46ec-8d0f-fae2f5c9ecf5 req-7086e9d5-cb1c-4984-8d32-f6763edd5e14 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:23.029245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-b193e097-8f19-46ec-8d0f-fae2f5c9ecf5 req-7086e9d5-cb1c-4984-8d32-f6763edd5e14 service nova] Creating event network-vif-plugged:5a349922-1225-4f59-a0fd-ba4359143870 for instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 on hv-cinder-83608 Aug 10 22:49:23.035880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-b193e097-8f19-46ec-8d0f-fae2f5c9ecf5 req-7086e9d5-cb1c-4984-8d32-f6763edd5e14 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049222 Aug 10 22:49:23.037454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 156/312] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:23.318235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:23.318842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:23.324945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:23.325659 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:23.326269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:23.326961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:23.327415 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:23.327839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:23.344483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] HTTP exception thrown: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Request method failure captured: Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 HTTP/1.1 Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWL8z9N5HaVhlV8UR7YA9yBWQE-TGFwQ1f2n3IVrDmHGCFtTSJhkO0UpVopPcuJk0usD0cVAOZe8uCBIuChW9Riq43Lr5a48h9L5LvxGCArVh8-oKENMs-5hpud7EOyQu-QGDVWwcgmcE_xSbmrDY5Wje0AiaBQPdv5JBPxFOlELcM Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:49:23.349747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}] Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 0d4dc87fae144ab9a40e1f047330168d Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.351002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5'} Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:49:23.351972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.353175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.355165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Returning 404 to user: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:49:23.355165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3bda0725-8cf9-4528-bc4c-3afb45330295 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 404 len: 111 microversion: 2.1 time: 0.040581 Aug 10 22:49:23.355508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 157/313] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:23 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:49:23.472279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:23.474525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:23.480956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:23.481466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:23.482101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:23.482838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:23.483364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:23.483825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:23.497874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] HTTP exception thrown: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Request method failure captured: Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5/os-volume_attachments HTTP/1.1 Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWL8z9N5HaVhlV8UR7YA9yBWQE-TGFwQ1f2n3IVrDmHGCFtTSJhkO0UpVopPcuJk0usD0cVAOZe8uCBIuChW9Riq43Lr5a48h9L5LvxGCArVh8-oKENMs-5hpud7EOyQu-QGDVWwcgmcE_xSbmrDY5Wje0AiaBQPdv5JBPxFOlELcM Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:49:23.503583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}] Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 0d4dc87fae144ab9a40e1f047330168d Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.504793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'server_id': '8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5'} Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:49:23.506063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:23.507486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:23.508979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Returning 404 to user: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:49:23.508979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c88665c1-56d0-4157-b5e7-8436b51b538e tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037227 Aug 10 22:49:23.508979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 157/314] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:49:23 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:49:23.538412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:23.539058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:23.545069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:23.545584 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:23.546006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:23.546880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:23.547328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:23.547852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:23.552582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:23.748389 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:23.757000 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-33bded7c-a550-42db-8cf7-67c5a782d2f6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.222639 Aug 10 22:49:23.757596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 158/315] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:23 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:24.747323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:24.747871 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:24.754061 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:24.754621 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:24.755116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:24.755866 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:24.756398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:24.756957 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:24.771050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] HTTP exception thrown: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Request method failure captured: Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 HTTP/1.1 Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWL8z9N5HaVhlV8UR7YA9yBWQE-TGFwQ1f2n3IVrDmHGCFtTSJhkO0UpVopPcuJk0usD0cVAOZe8uCBIuChW9Riq43Lr5a48h9L5LvxGCArVh8-oKENMs-5hpud7EOyQu-QGDVWwcgmcE_xSbmrDY5Wje0AiaBQPdv5JBPxFOlELcM Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:49:24.773189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}] Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 0d4dc87fae144ab9a40e1f047330168d Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.774694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5'} Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:49:24.775608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.776942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.778889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Returning 404 to user: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:49:24.778889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e26fde80-6b59-4351-9d02-dc5da824ad9f tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 404 len: 111 microversion: 2.1 time: 0.031211 Aug 10 22:49:24.778889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 158/316] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:49:24 2022] DELETE /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:49:24.781629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:24.782240 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:24.786449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:24.787417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] [instance: 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:24.791334 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:24.792041 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:24.792438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:24.793820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:24.793935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:24.794272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:24.794617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:24.794711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:24.795208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:24.796123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:24.796680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:24.797187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:24.812980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] HTTP exception thrown: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Request method failure captured: Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 HTTP/1.1 Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWL8z9N5HaVhlV8UR7YA9yBWQE-TGFwQ1f2n3IVrDmHGCFtTSJhkO0UpVopPcuJk0usD0cVAOZe8uCBIuChW9Riq43Lr5a48h9L5LvxGCArVh8-oKENMs-5hpud7EOyQu-QGDVWwcgmcE_xSbmrDY5Wje0AiaBQPdv5JBPxFOlELcM Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:49:24.815224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_aaae1e0f2ab8493cb12abbaf01f1833a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/aaae1e0f2ab8493cb12abbaf01f1833a"}]}] Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: aaae1e0f2ab8493cb12abbaf01f1833a Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087947141 Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 0d4dc87fae144ab9a40e1f047330168d Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-DeleteServersTestJSON-1087947141-project Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.816464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5'} Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:49:24.817139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. Aug 10 22:49:24.818286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:49:24.819258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] Returning 404 to user: Instance 8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:49:24.819258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-28655ce0-2720-4b4c-9a32-6db159fe8f77 tempest-DeleteServersTestJSON-1087947141 tempest-DeleteServersTestJSON-1087947141-project] 10.222.0.76 "GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5" status: 404 len: 111 microversion: 2.1 time: 0.035258 Aug 10 22:49:24.819258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 159/317] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:24 2022] GET /compute/v2.1/servers/8f17d0fa-2ac1-484b-a5eb-51291e0fd2d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:49:25.110103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:25.126066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2e4edb42-5b54-4c34-92dd-7d28f65a8995 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1311 microversion: 2.1 time: 0.352242 Aug 10 22:49:25.127385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 159/318] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:24 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1311 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:26.149340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:26.149882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:26.155780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:26.156476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:26.156913 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:26.158599 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:26.159431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:26.159824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:26.398800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:26.407078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-35564fe4-8b8c-47e9-bb82-66d8f9b5e379 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1495 microversion: 2.1 time: 0.261713 Aug 10 22:49:26.411679 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 160/319] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:26 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1495 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:27.078764 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:27.080745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:27.087702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:27.088490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:27.089127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:27.090059 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:27.090833 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:27.091457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:27.124302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:49:27.237899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9bbbf5b8-151f-42d9-bcba-c081d9d2612d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 204 len: 0 microversion: 2.1 time: 0.161156 Aug 10 22:49:27.242895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 160/320] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:49:27 2022] DELETE /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:49:27.252746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:27.254620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:27.261558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:27.262302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:27.262938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:27.264329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:27.265039 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:27.265768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:27.431716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-308402449", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:27.500634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] validate_networks() for None {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:49:27.561126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:27.571010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-acda1de4-e20e-48f9-b42b-12b4ac1da8a3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1501 microversion: 2.1 time: 0.326344 Aug 10 22:49:27.571615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 161/321] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:27 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1501 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:28.258192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:49:28.258898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:49:28.259580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:49:28.260162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:49:28.260578 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:49:28.271154 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:28.271696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:28.272221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:28.272989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:28.273918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:28.274115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:28.293971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Getting quotas for project dcf2ffea147f4700b67bfc7accdd0815. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:49:28.298212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Getting quotas for user e15f5f4d1ca74dba89d80dfa5ca87563 and project dcf2ffea147f4700b67bfc7accdd0815. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:49:28.311528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:49:28.314214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:49:28.365466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-943244d0-e414-44d6-83b9-9f2ba8d874e8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949188 Aug 10 22:49:28.372145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 161/322] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:49:28.377328 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4ccba0ae-9cf2-49b1-b175-d9c15655e972 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:28.377960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4ccba0ae-9cf2-49b1-b175-d9c15655e972 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:28.466352 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4ccba0ae-9cf2-49b1-b175-d9c15655e972 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:28.480785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4ccba0ae-9cf2-49b1-b175-d9c15655e972 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1214 microversion: 2.1 time: 0.107290 Aug 10 22:49:28.481506 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 162/323] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:28 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:28.592724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:28.593777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:28.601669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:28.602583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:28.603670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:28.604542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:28.604969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:28.605528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:28.807388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:28.817963 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-10d282cd-48db-4db0-9253-0be7eba1a0ab tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1501 microversion: 2.1 time: 0.229499 Aug 10 22:49:28.818693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 162/324] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:28 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:29.511590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:29.512344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:29.514449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:29.519990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:29.520681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:29.521505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:29.522363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:29.522806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:29.523459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:29.607267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:29.617085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1855e009-914f-4f8a-97b8-43c25af77658 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1210 microversion: 2.1 time: 0.109111 Aug 10 22:49:29.617694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 163/325] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:29 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:29.840747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:29.842242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:29.849537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:29.850188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:29.850854 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:29.851868 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:29.852393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:29.853043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:30.011700 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:30.020866 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2d50a1fb-e642-453b-b575-387ad48cb884 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1501 microversion: 2.1 time: 0.184591 Aug 10 22:49:30.021483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 163/326] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:29 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:30.646180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:30.647626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:30.659841 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:30.660714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:30.661385 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:30.662396 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:30.663239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:30.664453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:30.765175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:30.781688 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0403a30d-e43b-4c88-8ca3-800f85facffe tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1284 microversion: 2.1 time: 0.137152 Aug 10 22:49:30.793439 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 164/327] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:30 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:31.044170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:31.046152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:31.055723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:31.056483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:31.057072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:31.058671 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:31.059545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:31.060118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:31.088405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-f7a41386-580c-4560-83a3-9c05f235a765 req-160f30f1-9071-4497-a40f-fa7ae947190e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ea59d8-9100-4f06-a66a-fbd5cb617a45", "name": "network-vif-deleted", "tag": "5a349922-1225-4f59-a0fd-ba4359143870"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:31.119608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-f7a41386-580c-4560-83a3-9c05f235a765 req-160f30f1-9071-4497-a40f-fa7ae947190e service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:31.120205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-f7a41386-580c-4560-83a3-9c05f235a765 req-160f30f1-9071-4497-a40f-fa7ae947190e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:31.122417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-f7a41386-580c-4560-83a3-9c05f235a765 req-160f30f1-9071-4497-a40f-fa7ae947190e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:31.147937 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-f7a41386-580c-4560-83a3-9c05f235a765 req-160f30f1-9071-4497-a40f-fa7ae947190e service nova] Creating event network-vif-deleted:5a349922-1225-4f59-a0fd-ba4359143870 for instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 on hv-cinder-83608 Aug 10 22:49:31.153856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-f7a41386-580c-4560-83a3-9c05f235a765 req-160f30f1-9071-4497-a40f-fa7ae947190e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072768 Aug 10 22:49:31.155408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 165/328] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:49:31.185931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:31.202445 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a15fa18e-4d6b-4eb5-866a-91b557dc8c8f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 200 len: 1459 microversion: 2.1 time: 0.163701 Aug 10 22:49:31.205494 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 164/329] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:31 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 1459 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:31.805919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:31.807716 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:31.820151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:31.820780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:31.822401 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:31.825083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:31.825924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:31.826617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:32.030437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:32.040241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f2b8840b-93b8-4c77-b375-4fc926096e67 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.239995 Aug 10 22:49:32.042581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 166/330] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:31 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:32.225317 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:32.226086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: a0ea59d8-9100-4f06-a66a-fbd5cb617a45] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:32.234182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:32.234885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:32.236127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:32.237139 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:32.237790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:32.239030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:32.260506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] HTTP exception thrown: Instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 could not be found. Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Request method failure captured: Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 HTTP/1.1 Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DW2t3JAMJCEAhjTaX6u859wFPnNuZiVGvUM9ngPy5VWDKRgK-ana_S_NL9CaUgAJ0NovS8KD1hxZl2QLgJ8EFQhM1Kibvo0MXKbiEzlLUHjcyIaTY1HaSGe01W6rRh14jGEU-L069acC5HB7E8rDcpxD55RLSBQ2AfVsqXKLewA6GY Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 50a0ee776f574f46bdb5f16c1b864402 Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-VolumesActionsTest-217004922 Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:49:32.269585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/50a0ee776f574f46bdb5f16c1b864402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50a0ee776f574f46bdb5f16c1b864402"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_50a0ee776f574f46bdb5f16c1b864402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50a0ee776f574f46bdb5f16c1b864402"}]}] Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-VolumesActionsTest-217004922 Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 50a0ee776f574f46bdb5f16c1b864402 Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-VolumesActionsTest-217004922 Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-VolumesActionsTest-217004922-project Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 0f645ba95eb64bb2b23d0d38a141307a Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-VolumesActionsTest-217004922-project Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 could not be found. Aug 10 22:49:32.271063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': 'a0ea59d8-9100-4f06-a66a-fbd5cb617a45'} Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 could not be found. Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:49:32.271871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 could not be found. Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 could not be found. Aug 10 22:49:32.273027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:49:32.274212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Returning 404 to user: Instance a0ea59d8-9100-4f06-a66a-fbd5cb617a45 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:49:32.274212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a2d79f42-3b4f-428c-b6fb-a8e85b475233 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45" status: 404 len: 111 microversion: 2.1 time: 0.049681 Aug 10 22:49:32.277710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 165/331] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:32 2022] GET /compute/v2.1/servers/a0ea59d8-9100-4f06-a66a-fbd5cb617a45 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:49:32.404677 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2004207660", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "networks": [{"uuid": "59ff0254-3444-444b-935b-be74ef3dbe67"}]}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:32.474740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] validate_networks() for [('59ff0254-3444-444b-935b-be74ef3dbe67', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:49:33.065446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:33.066505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:33.075591 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:33.076757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:33.081764 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:33.085293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:33.087401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:33.088650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:33.483157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:33.492799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-60466420-cfb7-4e1c-a7b2-53fc41132612 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.432043 Aug 10 22:49:33.496691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 166/332] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:33 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:33.506107 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-cff44ea3-e1c7-4385-a4fe-9e0bf58bc2e5 req-45e62b14-dc38-4e2f-be67-6549cc74efcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ca0583a-4d51-48c1-b619-e13c86bd7bc8", "tag": "c572522e-2d9c-47f8-b3d8-07968b42e12f"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:33.537167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-cff44ea3-e1c7-4385-a4fe-9e0bf58bc2e5 req-45e62b14-dc38-4e2f-be67-6549cc74efcf service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:33.539367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-cff44ea3-e1c7-4385-a4fe-9e0bf58bc2e5 req-45e62b14-dc38-4e2f-be67-6549cc74efcf service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:33.544133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:49:33.545652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:49:33.546175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:49:33.546591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:49:33.547003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:49:33.557258 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-cff44ea3-e1c7-4385-a4fe-9e0bf58bc2e5 req-45e62b14-dc38-4e2f-be67-6549cc74efcf service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:33.570242 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:33.570736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:33.571171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:33.571904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:33.572360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:33.572785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:33.598453 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-cff44ea3-e1c7-4385-a4fe-9e0bf58bc2e5 req-45e62b14-dc38-4e2f-be67-6549cc74efcf service nova] Creating event network-changed:c572522e-2d9c-47f8-b3d8-07968b42e12f for instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 on hv-cinder-83608 Aug 10 22:49:33.603874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-cff44ea3-e1c7-4385-a4fe-9e0bf58bc2e5 req-45e62b14-dc38-4e2f-be67-6549cc74efcf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104911 Aug 10 22:49:33.608635 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 167/333] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:33.659655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Getting quotas for project 50a0ee776f574f46bdb5f16c1b864402. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:49:33.667611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Getting quotas for user 0f645ba95eb64bb2b23d0d38a141307a and project 50a0ee776f574f46bdb5f16c1b864402. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:49:33.704986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:49:33.707382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:49:33.803199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7d027a26-f491-4dc6-a240-450e15a460b6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402243 Aug 10 22:49:33.803883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 167/334] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:49:33.817868 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-976b640e-1500-4d26-9c4e-dc3b0570cd11 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:33.819237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-976b640e-1500-4d26-9c4e-dc3b0570cd11 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:33.917800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-976b640e-1500-4d26-9c4e-dc3b0570cd11 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:33.929614 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-976b640e-1500-4d26-9c4e-dc3b0570cd11 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1214 microversion: 2.1 time: 0.118418 Aug 10 22:49:33.930468 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 168/335] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:33 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:34.522085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:34.524417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:34.531729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:34.534009 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:34.534661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:34.535557 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:34.536177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:34.537492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:34.952063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:34.953297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:34.981896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:34.982458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:34.982910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:34.983652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:34.984237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:34.984802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:35.171274 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:35.172147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:35.184946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e89a41f3-d652-4a4d-a88b-a89fcd8b8a77 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.670093 Aug 10 22:49:35.190596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 168/336] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:34 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:35.223597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b7c0c7eb-8317-4f8b-a756-c23209f8e03d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1218 microversion: 2.1 time: 0.275956 Aug 10 22:49:35.224225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 169/337] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:34 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:36.210647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:36.218161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:36.225142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:36.225936 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:36.226599 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:36.227555 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:36.228219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:36.228845 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:36.244155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:36.245811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:36.256408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:36.257234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:36.257919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:36.259054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:36.261248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:36.261836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:36.390366 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:36.399247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-91efa18a-d27f-4631-8ccf-940220bb7f84 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1218 microversion: 2.1 time: 0.159142 Aug 10 22:49:36.400349 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 170/338] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:36 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:36.536381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:36.551669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-38d61a78-6873-4815-836d-35e2ef775efd tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.344539 Aug 10 22:49:36.552584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 169/339] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:36 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:37.421520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:37.423150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:37.444228 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:37.445354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:37.445896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:37.446735 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:37.449026 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:37.449825 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:37.573130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:37.581622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:37.582818 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:37.592438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a74addf6-c397-4b45-bfc0-7cbb85d8a206 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1218 microversion: 2.1 time: 0.175748 Aug 10 22:49:37.619035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 171/340] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:37 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:37.619239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:37.619239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:37.619239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:37.619239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:37.619674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:37.619674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:37.917444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:37.927343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a8cee5e5-ebc3-4551-9c36-184ff255bae1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.359137 Aug 10 22:49:37.927936 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 170/341] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:37 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:38.355653 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:38.585861 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1097751752", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:38.630600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:38.632812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:38.640662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:38.642605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:38.643895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:38.645033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:38.646019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:38.647503 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:38.656891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] validate_networks() for [('04293859-4608-4a33-b65a-9eb0fdac831d', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:49:38.755656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:38.763952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f3f142bc-a7d8-4219-8185-9a5c62814176 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1272 microversion: 2.1 time: 0.138867 Aug 10 22:49:38.768833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 171/342] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:38 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:38.963876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:38.964514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:38.978369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:38.979130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:38.981734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:38.983794 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:38.984439 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:38.985058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:39.204942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:39.217171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ced10856-747b-4168-8b79-2eb7a65b489b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.262093 Aug 10 22:49:39.218847 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 172/343] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:38 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:39.333054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:49:39.334358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:49:39.335312 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:49:39.336865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:49:39.338416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:49:39.356144 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:39.356712 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:39.357345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:39.358276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:39.358739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:39.378208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:39.404761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:49:39.411226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for user 6367371496f04cc2a7c105fbbed68dca and project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:49:39.434908 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:49:39.437178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:49:39.497835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-aebd90ed-0926-44f3-a059-c72b7970eaf0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.147401 Aug 10 22:49:39.501869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 172/344] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:49:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:49:39.511770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-22fb7cee-4043-48cf-abae-0cc480d70c89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:39.513114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-22fb7cee-4043-48cf-abae-0cc480d70c89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:39.600860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-22fb7cee-4043-48cf-abae-0cc480d70c89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:39.613984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-22fb7cee-4043-48cf-abae-0cc480d70c89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1222 microversion: 2.1 time: 0.108125 Aug 10 22:49:39.614692 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 173/345] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:39 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:39.702967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2111969681", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:39.765219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] validate_networks() for [('04293859-4608-4a33-b65a-9eb0fdac831d', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:49:39.786694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:39.787466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:39.793656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:39.794408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:39.794957 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:39.795816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:39.796272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:39.796697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:40.059363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:40.069334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cdd0b43b-8f9c-4deb-a0b9-8e927f7c38e9 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.289032 Aug 10 22:49:40.073600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 174/346] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:39 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:40.244640 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:40.245642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:40.256686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:40.258822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:40.260327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:40.261264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:40.261987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:40.262849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:40.324207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:40.499594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:49:40.500731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:49:40.501645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:49:40.503318 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:49:40.504024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:49:40.533005 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:40.534232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:40.534954 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:40.538326 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:40.539721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:40.540447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:40.554682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:40.562440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fb7005b9-6526-4de1-845e-870a96ca7ee7 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.322072 Aug 10 22:49:40.565532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 175/347] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:40 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:40.570592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-1eebe923-3c31-41a0-807e-a0f0fa932c23 req-a1acc125-df40-4fd8-a5dd-03011ea8e478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e75b766-2345-490e-85d7-f87c0b3faae3", "tag": "ba3cced4-036f-423e-974a-15d00d12f767"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:40.575458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:49:40.580719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for user 6367371496f04cc2a7c105fbbed68dca and project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:49:40.583667 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1eebe923-3c31-41a0-807e-a0f0fa932c23 req-a1acc125-df40-4fd8-a5dd-03011ea8e478 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:40.584334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1eebe923-3c31-41a0-807e-a0f0fa932c23 req-a1acc125-df40-4fd8-a5dd-03011ea8e478 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:40.584334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1eebe923-3c31-41a0-807e-a0f0fa932c23 req-a1acc125-df40-4fd8-a5dd-03011ea8e478 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:40.598336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-1eebe923-3c31-41a0-807e-a0f0fa932c23 req-a1acc125-df40-4fd8-a5dd-03011ea8e478 service nova] Creating event network-changed:ba3cced4-036f-423e-974a-15d00d12f767 for instance 1e75b766-2345-490e-85d7-f87c0b3faae3 on hv-cinder-83608 Aug 10 22:49:40.604324 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-1eebe923-3c31-41a0-807e-a0f0fa932c23 req-a1acc125-df40-4fd8-a5dd-03011ea8e478 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037379 Aug 10 22:49:40.605191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 176/348] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:40.607114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:49:40.609252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:49:40.662701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-eb15a99a-687f-4acf-a9e5-b0fb79fdc0ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.964014 Aug 10 22:49:40.664048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 173/349] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:49:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:49:40.676262 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-602d9f15-5976-4b5b-996d-961749af5c73 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:40.677221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-602d9f15-5976-4b5b-996d-961749af5c73 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:40.749308 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-602d9f15-5976-4b5b-996d-961749af5c73 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:40.756792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-602d9f15-5976-4b5b-996d-961749af5c73 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1222 microversion: 2.1 time: 0.085996 Aug 10 22:49:40.757840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 177/350] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:40 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:41.097101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:41.098586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:41.106781 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:41.107699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:41.108369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:41.109345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:41.110753 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:41.112032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:41.390641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:41.402507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-79f59b46-a887-48af-acd0-456465e07654 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.310055 Aug 10 22:49:41.403397 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 174/351] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:41 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:41.585420 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:41.587379 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:41.596701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:41.597846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:41.598733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:41.599652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:41.600334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:41.601026 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:41.715802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-edb76cc9-7841-4428-a39c-73e0965d0d00 req-1b05e516-a652-4d7c-98e4-4ef68988ce42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca0583a-4d51-48c1-b619-e13c86bd7bc8", "name": "network-vif-plugged", "status": "completed", "tag": "c572522e-2d9c-47f8-b3d8-07968b42e12f"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:41.728478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-edb76cc9-7841-4428-a39c-73e0965d0d00 req-1b05e516-a652-4d7c-98e4-4ef68988ce42 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:41.729235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-edb76cc9-7841-4428-a39c-73e0965d0d00 req-1b05e516-a652-4d7c-98e4-4ef68988ce42 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:41.729702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-edb76cc9-7841-4428-a39c-73e0965d0d00 req-1b05e516-a652-4d7c-98e4-4ef68988ce42 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:41.759838 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-edb76cc9-7841-4428-a39c-73e0965d0d00 req-1b05e516-a652-4d7c-98e4-4ef68988ce42 service nova] Creating event network-vif-plugged:c572522e-2d9c-47f8-b3d8-07968b42e12f for instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 on hv-cinder-83608 Aug 10 22:49:41.765178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-edb76cc9-7841-4428-a39c-73e0965d0d00 req-1b05e516-a652-4d7c-98e4-4ef68988ce42 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054556 Aug 10 22:49:41.766806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 175/352] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:41.778872 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:41.779874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:41.786964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:41.787773 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:41.788554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:41.789528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:41.790742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:41.791644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:41.871065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:41.879625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e018b555-17a2-474d-aeeb-74e74f4ff6b7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1274 microversion: 2.1 time: 0.105357 Aug 10 22:49:41.881452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 176/353] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:41 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:41.941595 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:41.950224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-aa7a00e0-c5a0-4e58-b6cd-8a3c6c2156b2 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.369683 Aug 10 22:49:41.951458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 178/354] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:41 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:42.425623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:42.425623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:42.431704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:42.432198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:42.432699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:42.433435 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:42.433892 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:42.434317 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:42.643523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:42.653573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a3cae612-6822-49c0-85a7-d5df3f6025e4 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.233108 Aug 10 22:49:42.654520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 177/355] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:42 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:42.903372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:42.905093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:42.916323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:42.917320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:42.918277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:42.919371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:42.920044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:42.920687 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:42.972570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:42.974651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:42.985607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:42.986080 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:42.986517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:42.987215 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:42.991068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:42.991763 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:43.009796 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:43.029739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:43.041077 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-464c3cbf-8c43-4685-aa55-e61e84b58784 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1280 microversion: 2.1 time: 0.143456 Aug 10 22:49:43.044516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 179/356] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:42 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:43.188687 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:43.196577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-35cda267-5a3e-4e90-9d63-59b90991c732 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.228368 Aug 10 22:49:43.198005 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 178/357] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:42 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:43.676819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:43.677933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:43.680059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:43.689897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:43.690779 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:43.692361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:43.693608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:43.695153 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:43.697723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:43.855404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:43.864168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-06eb53bd-1e65-4b04-a41a-5569e22e7b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.192014 Aug 10 22:49:43.864736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 180/358] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:43 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:44.065918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:44.066779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:44.074850 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:44.075405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:44.075840 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:44.076548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:44.076994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:44.077460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:44.216185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:44.217504 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:44.218121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:44.223947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4b5b4235-6559-41df-94ba-a39f131e1eb9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.162380 Aug 10 22:49:44.224095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:44.224513 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 179/359] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:44 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:44.224628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:44.224968 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:44.225760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:44.226212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:44.226633 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:44.357644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:44.365168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-15129022-a1a2-4a7a-b625-851885cbf577 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.151363 Aug 10 22:49:44.373433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 181/360] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:44 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:44.885806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:44.886606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:44.888647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:44.894784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:44.895562 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:44.896075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:44.896860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:44.897420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:44.897915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:45.044156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:45.054573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-638ae6a9-6172-4ea4-8e2f-5341bc8abbd6 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.172428 Aug 10 22:49:45.055150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 180/361] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:44 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:45.245069 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:45.245713 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:45.251662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:45.252151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:45.252586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:45.253299 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:45.253763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:45.254190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:45.386125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:45.386736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:45.393478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:45.393965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:45.394572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:45.395281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:45.395734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:45.396198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:45.698876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:45.707477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7fe04898-a342-444f-bdba-9f5f81e82938 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.466245 Aug 10 22:49:45.708157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 182/362] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:45 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:45.826612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:45.835072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b314d630-d321-4269-9902-a1abc137ee6b tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.452849 Aug 10 22:49:45.835760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 181/363] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:45 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:46.076553 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:46.077177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:46.084598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:46.085093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:46.085574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:46.086265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:46.086721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:46.087316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:46.233198 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:46.241810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-19b71f9a-8159-43b9-b887-2f0222c738d0 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.169692 Aug 10 22:49:46.242379 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 183/364] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:46 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:46.728437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:46.729042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:46.735600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:46.736100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:46.736528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:46.737221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:46.737716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:46.738140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:46.857642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:46.858335 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:46.864394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:46.864881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:46.865331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:46.866044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:46.866506 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:46.866920 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:46.880564 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:46.891808 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6c35fc26-e42b-4d85-b2df-cd6c210c664a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.167090 Aug 10 22:49:46.895965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 182/365] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:46 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:47.001807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:47.009949 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1c7512f5-9ff6-4dcc-a973-93a04d1d2a25 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.156549 Aug 10 22:49:47.015785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 184/366] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:46 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:47.261564 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:47.262181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:47.268226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:47.268857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:47.269543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:47.270356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:47.270884 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:47.271381 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:47.453584 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:47.460981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ca26ee39-b732-4351-980e-15aa75395ff2 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.203334 Aug 10 22:49:47.461593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 183/367] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:47 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:47.919370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:47.920301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:47.927877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:47.928366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:47.928805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:47.929534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:47.929991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:47.930412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:48.032889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:48.034161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:48.041327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:48.042431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:48.043073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:48.044001 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:48.045390 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:48.046014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:48.129168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:48.139035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e04db719-40ee-420f-a271-009676a50cfa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.225888 Aug 10 22:49:48.161295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 185/368] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:47 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:48.205916 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:48.213573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cac5a077-1942-44f7-879b-f418ce46fbd8 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.186327 Aug 10 22:49:48.214138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 184/369] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:48 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:48.482489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:48.483133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:48.489104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:48.489619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:48.490052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:48.490743 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:48.491193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:48.491616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:48.627304 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:48.635325 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-510c4b6c-11e3-48f4-ab34-ec0de0c5ca78 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.156527 Aug 10 22:49:48.636106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 186/370] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:48 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:49.163939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:49.164555 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:49.171030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:49.172081 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:49.172731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:49.174093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:49.174706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:49.175288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:49.234971 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:49.235563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:49.253909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:49.255072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:49.255939 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:49.256937 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:49.257636 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:49.258298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:49.481373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:49.497901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-706a8e1a-e52e-42a0-82ef-19bf9a3d9c70 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.337679 Aug 10 22:49:49.500034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 185/371] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:49 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:49.540602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:49.552260 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ba589506-4388-4a4a-acf0-93f86f60b1a3 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1314 microversion: 2.1 time: 0.321713 Aug 10 22:49:49.568095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 187/372] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:49 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:49.669229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:49.670507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:49.677889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:49.678772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:49.679403 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:49.680350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:49.681069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:49.681711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:49.932019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:49.966726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d28c2e25-28ac-4306-9da8-354286cba5ea tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.311397 Aug 10 22:49:49.969339 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 186/373] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:49 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:50.139155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-062d693f-35a6-4074-95b8-b37c6eb32c2c req-2421b710-334a-49a9-800d-1c2c231fc62d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ebe63a-b81b-4a3e-8ab3-73ccf0173447", "tag": "14e5811e-4417-40ea-b407-30b590d4a386"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:50.150822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-062d693f-35a6-4074-95b8-b37c6eb32c2c req-2421b710-334a-49a9-800d-1c2c231fc62d service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.151414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-062d693f-35a6-4074-95b8-b37c6eb32c2c req-2421b710-334a-49a9-800d-1c2c231fc62d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.151905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-062d693f-35a6-4074-95b8-b37c6eb32c2c req-2421b710-334a-49a9-800d-1c2c231fc62d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.163817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-062d693f-35a6-4074-95b8-b37c6eb32c2c req-2421b710-334a-49a9-800d-1c2c231fc62d service nova] Creating event network-changed:14e5811e-4417-40ea-b407-30b590d4a386 for instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 on hv-cinder-83608 Aug 10 22:49:50.168647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-062d693f-35a6-4074-95b8-b37c6eb32c2c req-2421b710-334a-49a9-800d-1c2c231fc62d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Aug 10 22:49:50.169218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 188/374] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:50.521235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:50.522511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:50.530650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.531350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.531942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.532812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.533321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.533735 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.561219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:50.584428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:50.593454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:50.595598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=20 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:50.607483 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.607990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.608431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.609411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.610103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.610538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.749418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:50.753967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=12 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:50.757396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3d966651-7faa-4227-a267-e6135f8c0ffe tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.240260 Aug 10 22:49:50.757980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 187/375] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:50 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:50.795167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:50.804238 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6b8e5261-379b-490a-84d7-0b9b2a4570b1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1462 microversion: 2.1 time: 0.229992 Aug 10 22:49:50.804896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 189/376] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:50 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1462 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:50.850852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:50.851338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:50.857136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.857647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.858077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.859529 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.860018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.860436 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.884367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:49:50.958697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5e4f0aac-802c-4d6c-9f73-9d6ed003ba02 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 204 len: 0 microversion: 2.1 time: 0.111372 Aug 10 22:49:50.959269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 188/377] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:49:50 2022] DELETE /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:49:50.967521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:50.968162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:50.974047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.974528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.974964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.975652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.976100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.976521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.990429 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:50.991128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:50.997243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.997694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:50.998133 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:50.998870 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:50.999986 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:51.000554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:51.180005 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:51.184131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:51.188676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d9e44978-542b-43b9-be1f-7d05e0440702 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1468 microversion: 2.1 time: 0.224607 Aug 10 22:49:51.189511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 190/378] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:50 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1468 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:51.192761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f35d50e7-0071-42dd-96a6-2b32ab67034e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.206349 Aug 10 22:49:51.198577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 189/379] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:50 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:51.778050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:51.778687 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:51.785110 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:51.785624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:51.786063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:51.786747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:51.787200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:51.787622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:51.916893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:51.930511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a2fe0ce1-82ea-4675-8dcf-6c200f0e843d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.156264 Aug 10 22:49:51.931083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 191/380] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:51 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:52.211648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:52.212251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:52.214630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-16f8384e-8fb1-4bfd-b3ed-194563a1101b req-07f55cfb-8c58-4736-89fa-e6066987243d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2", "tag": "fa99d083-4ee8-4451-8b09-65ab49e795b1"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:52.220648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.221141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.221596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:52.222462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.223068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.223490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:52.225354 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-16f8384e-8fb1-4bfd-b3ed-194563a1101b req-07f55cfb-8c58-4736-89fa-e6066987243d service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.225837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-16f8384e-8fb1-4bfd-b3ed-194563a1101b req-07f55cfb-8c58-4736-89fa-e6066987243d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.226270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-16f8384e-8fb1-4bfd-b3ed-194563a1101b req-07f55cfb-8c58-4736-89fa-e6066987243d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:52.237729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-16f8384e-8fb1-4bfd-b3ed-194563a1101b req-07f55cfb-8c58-4736-89fa-e6066987243d service nova] Creating event network-changed:fa99d083-4ee8-4451-8b09-65ab49e795b1 for instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 on hv-cinder-83608 Aug 10 22:49:52.242876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-16f8384e-8fb1-4bfd-b3ed-194563a1101b req-07f55cfb-8c58-4736-89fa-e6066987243d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031777 Aug 10 22:49:52.243793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 192/381] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:52.249025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:52.249805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:52.255972 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.256671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.257258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:52.258123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.259458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.260044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:52.439831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:52.450124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-103ec86b-08cf-4cd2-99bc-2673e8413287 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1468 microversion: 2.1 time: 0.242461 Aug 10 22:49:52.456224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:52.460069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 190/382] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:52 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1468 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:52.469702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-ee489cb3-1f14-4e38-bf5c-9cf0ea9dc6a5 req-96dd40d1-cb46-499f-a058-d52bb0e06a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e75b766-2345-490e-85d7-f87c0b3faae3", "name": "network-vif-plugged", "status": "completed", "tag": "ba3cced4-036f-423e-974a-15d00d12f767"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:52.475462 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fb0aad94-7a46-4974-b8ca-4ad4d39b0089 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.227121 Aug 10 22:49:52.479438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ee489cb3-1f14-4e38-bf5c-9cf0ea9dc6a5 req-96dd40d1-cb46-499f-a058-d52bb0e06a1e service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.479922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ee489cb3-1f14-4e38-bf5c-9cf0ea9dc6a5 req-96dd40d1-cb46-499f-a058-d52bb0e06a1e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.480346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ee489cb3-1f14-4e38-bf5c-9cf0ea9dc6a5 req-96dd40d1-cb46-499f-a058-d52bb0e06a1e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:52.484620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 193/383] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:52 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:52.491874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-ee489cb3-1f14-4e38-bf5c-9cf0ea9dc6a5 req-96dd40d1-cb46-499f-a058-d52bb0e06a1e service nova] Creating event network-vif-plugged:ba3cced4-036f-423e-974a-15d00d12f767 for instance 1e75b766-2345-490e-85d7-f87c0b3faae3 on hv-cinder-83608 Aug 10 22:49:52.496634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-ee489cb3-1f14-4e38-bf5c-9cf0ea9dc6a5 req-96dd40d1-cb46-499f-a058-d52bb0e06a1e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033559 Aug 10 22:49:52.497222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 191/384] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:52.951361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:52.951974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:52.958275 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.958759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.959199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:52.959894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:52.960350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:52.960773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:53.096163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:53.099670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:53.104628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-58d90024-3189-4c6e-97ab-d53e14be5a26 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.157052 Aug 10 22:49:53.105211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 194/385] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:52 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:53.474149 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:53.474842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:53.480955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:53.481485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:53.481929 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:53.484798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:53.484798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:53.484798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:53.495539 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:53.496682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:53.509691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:53.510295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:53.510805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:53.515534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:53.516083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:53.516812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:53.708746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:53.716654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-63ba4a4b-c4c3-4372-8959-ae21862156d5 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1468 microversion: 2.1 time: 0.247501 Aug 10 22:49:53.717213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 192/386] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:53 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:53.725563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:53.733020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-64d65f01-49a5-448c-9fc1-d22ce3787e34 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.242870 Aug 10 22:49:53.746821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 195/387] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:53 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:54.126077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:54.126693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:54.133205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:54.133742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:54.134180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:54.135187 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:54.135648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:54.136074 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:54.277452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:54.281351 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:54.287469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-04bb2c50-e799-47ab-ba45-bac62900aca4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.165427 Aug 10 22:49:54.288056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 193/388] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:54 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:54.737955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:54.738561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:54.744480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:54.744952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:54.745415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:54.746101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:54.746546 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:54.746963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:54.755162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:54.755774 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:54.762581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:54.763083 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:54.763523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:54.764228 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:54.765372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:54.766038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:54.957662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:54.962800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:54.965886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f630c06d-cdde-493d-aa36-1c20587ada1c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1468 microversion: 2.1 time: 0.231743 Aug 10 22:49:54.966716 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 196/389] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:54 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1468 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:54.971313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2dff8255-6f0d-472e-96ff-dddb1cafa505 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.220099 Aug 10 22:49:54.971949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 194/390] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:54 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:55.310895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:55.312098 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:55.318170 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:55.318655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:55.319090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:55.319784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:55.320242 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:55.320665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:55.463508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:55.471502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e9e425d3-4587-4548-a018-07ae6a904089 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.165302 Aug 10 22:49:55.472066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 197/391] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:55 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:55.988138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:55.988760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:55.992089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:55.992838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:55.995618 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:55.996115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:55.996551 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:55.997251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:55.997743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:55.998168 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:55.998986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:55.999496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:55.999924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:56.000609 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:56.001056 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:56.001497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:56.200896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:56.205268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:56.209394 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3c3eedd5-218d-494e-90c4-017618b15234 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1468 microversion: 2.1 time: 0.225239 Aug 10 22:49:56.209934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 195/392] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:55 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:56.216201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b49fb87-6038-4603-bf14-f97d16ac430e", "device": "/dev/sdb"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:56.219471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:56.219779 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-62f4c777-2b55-44b3-a431-47dca320e974 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.231418 Aug 10 22:49:56.220434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 198/393] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:55 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:56.227358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:56.227959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:56.228400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:56.229101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:56.229582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:56.230004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:56.372860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-51886e4a-6abf-415f-9a45-8e8468284ba4 req-d37ec89b-ab59-4d9d-9ee3-d89d5dda5e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca0583a-4d51-48c1-b619-e13c86bd7bc8", "name": "network-vif-unplugged", "status": "completed", "tag": "c572522e-2d9c-47f8-b3d8-07968b42e12f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:56.386602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-51886e4a-6abf-415f-9a45-8e8468284ba4 req-d37ec89b-ab59-4d9d-9ee3-d89d5dda5e31 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:56.387446 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-51886e4a-6abf-415f-9a45-8e8468284ba4 req-d37ec89b-ab59-4d9d-9ee3-d89d5dda5e31 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:56.388186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-51886e4a-6abf-415f-9a45-8e8468284ba4 req-d37ec89b-ab59-4d9d-9ee3-d89d5dda5e31 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:56.406296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-51886e4a-6abf-415f-9a45-8e8468284ba4 req-d37ec89b-ab59-4d9d-9ee3-d89d5dda5e31 service nova] Creating event network-vif-unplugged:c572522e-2d9c-47f8-b3d8-07968b42e12f for instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 on hv-cinder-83608 Aug 10 22:49:56.411911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-51886e4a-6abf-415f-9a45-8e8468284ba4 req-d37ec89b-ab59-4d9d-9ee3-d89d5dda5e31 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044927 Aug 10 22:49:56.412996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 199/394] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:56.492530 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:56.493229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:56.499574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:56.500118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:56.500560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:56.501295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:56.501806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:56.502437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:56.636598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:56.644618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-295943dc-43c1-420c-82bd-178299628404 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.156158 Aug 10 22:49:56.645115 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 200/395] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:56 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:57.230727 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:57.231546 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:57.238141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:57.238631 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:57.239065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:57.239764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:57.240322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:57.240848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:57.372882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:57.381600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-250cf01b-6646-44ad-a735-59e7e444bafc tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1468 microversion: 2.1 time: 0.154641 Aug 10 22:49:57.382368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 201/396] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:57 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:57.386881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:57.387487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:57.393801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:57.394470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:57.394901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:57.395581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:57.396566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:57.396566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:57.535565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:57.543569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-438bab43-c370-424f-a8c4-4344445a2b5f tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.160135 Aug 10 22:49:57.544217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 202/397] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:57 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:57.664853 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:57.665487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:57.672205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:57.672694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:57.673424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:57.674121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:57.674730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:57.675306 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:57.865402 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:57.876195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-faaa0d4f-5c92-4581-a089-14026979b80e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.214982 Aug 10 22:49:57.887564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 203/398] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:57 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:57.887564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-37dcd35d-85b6-4971-aaef-af4295922708 req-e3d96896-afb1-4997-9884-b18421b740f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca0583a-4d51-48c1-b619-e13c86bd7bc8", "name": "network-vif-deleted", "tag": "c572522e-2d9c-47f8-b3d8-07968b42e12f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:49:57.892391 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:49:57.903510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-37dcd35d-85b6-4971-aaef-af4295922708 req-e3d96896-afb1-4997-9884-b18421b740f4 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:57.904005 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-37dcd35d-85b6-4971-aaef-af4295922708 req-e3d96896-afb1-4997-9884-b18421b740f4 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:57.904516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-37dcd35d-85b6-4971-aaef-af4295922708 req-e3d96896-afb1-4997-9884-b18421b740f4 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:57.934273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-37dcd35d-85b6-4971-aaef-af4295922708 req-e3d96896-afb1-4997-9884-b18421b740f4 service nova] Creating event network-vif-deleted:c572522e-2d9c-47f8-b3d8-07968b42e12f for instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 on hv-cinder-83608 Aug 10 22:49:57.943133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-37dcd35d-85b6-4971-aaef-af4295922708 req-e3d96896-afb1-4997-9884-b18421b740f4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063186 Aug 10 22:49:57.944696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 204/399] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:58.173674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c8693b20-72f9-4810-87a2-d45d099cc353 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "POST /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.962021 Aug 10 22:49:58.174515 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 196/400] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:49:56 2022] POST /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0/os-volume_attachments => generated 194 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:49:58.404600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:58.405587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:58.414730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:58.415374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:58.415915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:58.416623 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:58.417167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:58.417619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:58.462661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:58.463361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:58.463950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:58.464563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lazy-loading 'fault' on Instance uuid 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:49:58.516169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:58.529450 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bf287fc7-d482-4461-bc34-fd4e8c4c418c tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1304 microversion: 2.1 time: 0.128977 Aug 10 22:49:58.530521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 205/401] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:58 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:58.566842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:58.568182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:58.577882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:58.578378 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:58.579042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:58.579770 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:58.580234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:58.580711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:58.753166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:58.760540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-dd09d62d-ba70-4b07-a4a5-2548d76f5e95 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1314 microversion: 2.1 time: 0.199907 Aug 10 22:49:58.761110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 197/402] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:58 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:49:58.900362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:58.900973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:58.907231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:58.907719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:58.908174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:58.908857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:58.909345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:58.909773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:59.054710 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:59.062978 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f8017720-de6b-4475-9e5a-62aaf2653607 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.166977 Aug 10 22:49:59.063545 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 206/403] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:58 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:59.551577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:59.552184 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:59.558566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:59.559053 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:59.559490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:59.560183 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:59.560638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:59.561064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:59.591332 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:59.591808 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:59.592245 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:59.592688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lazy-loading 'fault' on Instance uuid 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:49:59.634475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:59.642828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1b357f1b-c822-45de-b2bb-911935483784 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1304 microversion: 2.1 time: 0.095387 Aug 10 22:49:59.643388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 198/404] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:59 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:49:59.782438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:49:59.782984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:49:59.788830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:59.789343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:59.789775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:59.790454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:49:59.790898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:49:59.791316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:49:59.920704 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:49:59.928538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-775ec4f6-281f-45d0-acc2-e996d8d2cadf tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1498 microversion: 2.1 time: 0.151009 Aug 10 22:49:59.929095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 207/405] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:49:59 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:00.083131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:00.083693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:00.090208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.090696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.091138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.091834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.092289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.092726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.232906 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:00.241458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cb22308c-903d-4ef4-a2e2-4edbb93552b1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.161975 Aug 10 22:50:00.242024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 199/406] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:00 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:00.486977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:00.487497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:00.493564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.494039 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.494470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.495161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.495592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.496006 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.520929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:50:00.595694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d8a43332-376d-4745-85fc-f687432e4723 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 204 len: 0 microversion: 2.1 time: 0.112926 Aug 10 22:50:00.596276 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 208/407] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:50:00 2022] DELETE /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:50:00.604353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:00.604900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:00.611822 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.612305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.612737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.613451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.613908 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.614328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.664490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:00.665300 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:00.671734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.672217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.672905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.673642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.674090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.674513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.709707 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:00.710179 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:00.710606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:00.711041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lazy-loading 'fault' on Instance uuid 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:50:00.767475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:00.774739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8a2094a9-2954-4f92-91a4-db7751bb1e2f tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1304 microversion: 2.1 time: 0.114452 Aug 10 22:50:00.775303 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 209/408] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:00 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:00.784343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:00.791845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-42801bda-bfb7-4bbe-9d5d-5a13d43b693d tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1504 microversion: 2.1 time: 0.191230 Aug 10 22:50:00.792413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 200/409] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:00 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:01.106272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-2e867f48-18d5-4b7d-8197-6d567a8ce2b4 req-4f380094-ebba-4b8a-be68-aed79380e524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ebe63a-b81b-4a3e-8ab3-73ccf0173447", "name": "network-vif-plugged", "status": "completed", "tag": "14e5811e-4417-40ea-b407-30b590d4a386"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:50:01.117044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-2e867f48-18d5-4b7d-8197-6d567a8ce2b4 req-4f380094-ebba-4b8a-be68-aed79380e524 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.117951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-2e867f48-18d5-4b7d-8197-6d567a8ce2b4 req-4f380094-ebba-4b8a-be68-aed79380e524 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.117951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-2e867f48-18d5-4b7d-8197-6d567a8ce2b4 req-4f380094-ebba-4b8a-be68-aed79380e524 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.129091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-2e867f48-18d5-4b7d-8197-6d567a8ce2b4 req-4f380094-ebba-4b8a-be68-aed79380e524 service nova] Creating event network-vif-plugged:14e5811e-4417-40ea-b407-30b590d4a386 for instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 on hv-cinder-83608 Aug 10 22:50:01.134116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-2e867f48-18d5-4b7d-8197-6d567a8ce2b4 req-4f380094-ebba-4b8a-be68-aed79380e524 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031550 Aug 10 22:50:01.134717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 210/410] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:50:01.262068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:01.262596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:01.269918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.270403 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.270849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.271548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.272008 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.272435 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.404095 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:01.412426 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0be82547-35fa-4cd8-9749-81dfa0130cbd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.154222 Aug 10 22:50:01.413105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 201/411] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:01 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:01.797752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:01.798464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:01.805080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.805609 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.806115 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.806816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.807314 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.807741 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.813059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:01.814902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:01.815752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:01.822535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.823018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.823455 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.824150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.824604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.825022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.841134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:01.841642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:01.842079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:01.842523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lazy-loading 'fault' on Instance uuid 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:50:01.908831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:01.916349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bc8a2a07-fc55-42b3-b610-6fa8b58d1cb1 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1304 microversion: 2.1 time: 0.123931 Aug 10 22:50:01.916921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 211/412] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:01 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:01.978714 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:01.986805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-69b58652-7d1c-4847-889a-b4dc6c4664f3 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1504 microversion: 2.1 time: 0.176952 Aug 10 22:50:01.987373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 202/413] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:01 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:02.434123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:02.434753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:02.441113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:02.441628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:02.442070 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:02.442760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:02.443214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:02.443679 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:02.573784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:02.581811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9ade0ba9-a4fa-4177-8946-81a0439b1563 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.151573 Aug 10 22:50:02.582382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 212/414] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:02 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:02.942769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:02.942769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:02.945534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:02.946028 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:02.946471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:02.947174 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:02.947633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:02.948061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:02.985367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:02.985861 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:02.986308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:02.986757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lazy-loading 'fault' on Instance uuid 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:50:03.007912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:03.008811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:03.024834 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:03.028482 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:03.028933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:03.033097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f5f4d1ca74dba89d80dfa5ca87563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2ffea147f4700b67bfc7accdd0815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:03.036194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:03.036697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:03.037317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:03.041118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2f03bf82-9602-4e2f-ae84-30e09fdb77ad tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 200 len: 1304 microversion: 2.1 time: 0.107371 Aug 10 22:50:03.042413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 203/415] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:02 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:03.216277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:03.225561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3eb89e3c-c7bc-4bb1-a50e-04538decbfa5 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1504 microversion: 2.1 time: 0.221345 Aug 10 22:50:03.226233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 213/416] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:03 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:03.603115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:03.603839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:03.610387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:03.610894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:03.611329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:03.612018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:03.612463 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:03.612884 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:03.743204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:03.751477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-616da528-50d4-4451-af67-4dd54c0e3e75 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.152263 Aug 10 22:50:03.752056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 204/417] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:03 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:04.063903 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:04.064430 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] [instance: 6ca0583a-4d51-48c1-b619-e13c86bd7bc8] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:04.070961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:04.071447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:04.071883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:04.072577 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:04.073032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:04.073488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:04.088213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] HTTP exception thrown: Instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 could not be found. Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Request method failure captured: Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 HTTP/1.1 Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DX08WFu5-PCGGlcc0Fno3TfYHmNfpqFh_eIC0GBVIlujIHuHs-xeiPuzAy2IV14Mq5gx4fkSKLW0yZoMZRnkHMeM91fVZN3HKIfgloDiv9dE8BHrDGHa5jBVjoVMGoOW2DHGeEzC9An2fAdWBi4S2Et9tCJEE2Np_IRtX88Q3Q7104 Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: dcf2ffea147f4700b67bfc7accdd0815 Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesNegativeTest-255144593 Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:50:04.089870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/dcf2ffea147f4700b67bfc7accdd0815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dcf2ffea147f4700b67bfc7accdd0815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_dcf2ffea147f4700b67bfc7accdd0815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/dcf2ffea147f4700b67bfc7accdd0815"}]}] Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesNegativeTest-255144593 Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: dcf2ffea147f4700b67bfc7accdd0815 Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesNegativeTest-255144593 Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesNegativeTest-255144593-project Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: e15f5f4d1ca74dba89d80dfa5ca87563 Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesNegativeTest-255144593-project Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 could not be found. Aug 10 22:50:04.091339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '6ca0583a-4d51-48c1-b619-e13c86bd7bc8'} Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 could not be found. Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:50:04.092090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 could not be found. Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 could not be found. Aug 10 22:50:04.093730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:50:04.095731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] Returning 404 to user: Instance 6ca0583a-4d51-48c1-b619-e13c86bd7bc8 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:50:04.095731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1a9de9f4-a805-4c56-8ad8-083f45ca7449 tempest-VolumesNegativeTest-255144593 tempest-VolumesNegativeTest-255144593-project] 10.222.0.76 "GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8" status: 404 len: 111 microversion: 2.1 time: 0.031879 Aug 10 22:50:04.095731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 214/418] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:04 2022] GET /compute/v2.1/servers/6ca0583a-4d51-48c1-b619-e13c86bd7bc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:50:04.246540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:04.247153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:04.254252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:04.254741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:04.255180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:04.255881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:04.256329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:04.256752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:04.393533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:04.401040 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-28878cc3-e808-4067-ba46-10c7832f5998 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1504 microversion: 2.1 time: 0.158363 Aug 10 22:50:04.401642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 205/419] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:04 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:04.773696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:04.774473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:04.782605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:04.783206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:04.783652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:04.784490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:04.784950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:04.785405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:04.996653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:05.005983 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-815832bc-0381-4650-abf6-4f4c5cde5ea4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.237937 Aug 10 22:50:05.006808 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 215/420] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:04 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:05.408423 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-15233431-08e1-46be-a628-8579e082b18a req-de39bdf3-0faf-4346-9df2-30976cbb3262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2", "name": "network-vif-plugged", "status": "completed", "tag": "fa99d083-4ee8-4451-8b09-65ab49e795b1"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:50:05.428183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:05.429554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:05.440470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-15233431-08e1-46be-a628-8579e082b18a req-de39bdf3-0faf-4346-9df2-30976cbb3262 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:05.441526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-15233431-08e1-46be-a628-8579e082b18a req-de39bdf3-0faf-4346-9df2-30976cbb3262 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:05.443498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:05.443841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-15233431-08e1-46be-a628-8579e082b18a req-de39bdf3-0faf-4346-9df2-30976cbb3262 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:05.445699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:05.447500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:05.448745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:05.453219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:05.454246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:05.476303 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-15233431-08e1-46be-a628-8579e082b18a req-de39bdf3-0faf-4346-9df2-30976cbb3262 service nova] Creating event network-vif-plugged:fa99d083-4ee8-4451-8b09-65ab49e795b1 for instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 on hv-cinder-83608 Aug 10 22:50:05.487692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-15233431-08e1-46be-a628-8579e082b18a req-de39bdf3-0faf-4346-9df2-30976cbb3262 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086418 Aug 10 22:50:05.488791 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 206/421] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:50:05.652807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:05.661386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-997f3e09-e7c4-44bc-84d1-97044dd8dc79 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1504 microversion: 2.1 time: 0.238808 Aug 10 22:50:05.662336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 216/422] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:05 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:06.028599 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:06.029435 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:06.043533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:06.044248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:06.044691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:06.045493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:06.045947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:06.046542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:06.391874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:06.426518 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-482c5b6d-a49c-4301-b333-4993a1d6f5dc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.386120 Aug 10 22:50:06.427420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 207/423] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:06 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:06.684538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:06.685162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:06.692406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:06.693058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:06.693583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:06.694296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:06.694857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:06.695165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:06.758539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-053c32c9-3f92-4b5e-8d18-17485b0f8d4e req-fa92df95-c232-4d9e-8e96-c207b59f325b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e75b766-2345-490e-85d7-f87c0b3faae3", "name": "network-vif-deleted", "tag": "ba3cced4-036f-423e-974a-15d00d12f767"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:50:06.778784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-053c32c9-3f92-4b5e-8d18-17485b0f8d4e req-fa92df95-c232-4d9e-8e96-c207b59f325b service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:06.779283 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-053c32c9-3f92-4b5e-8d18-17485b0f8d4e req-fa92df95-c232-4d9e-8e96-c207b59f325b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:06.779728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-053c32c9-3f92-4b5e-8d18-17485b0f8d4e req-fa92df95-c232-4d9e-8e96-c207b59f325b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:06.805211 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-053c32c9-3f92-4b5e-8d18-17485b0f8d4e req-fa92df95-c232-4d9e-8e96-c207b59f325b service nova] Creating event network-vif-deleted:ba3cced4-036f-423e-974a-15d00d12f767 for instance 1e75b766-2345-490e-85d7-f87c0b3faae3 on hv-cinder-83608 Aug 10 22:50:06.808912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:06.823052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a3d73ec2-0a61-45dc-b7fb-83b58cab0501 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1462 microversion: 2.1 time: 0.143707 Aug 10 22:50:06.823647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 217/424] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:06 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1462 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:06.825230 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-053c32c9-3f92-4b5e-8d18-17485b0f8d4e req-fa92df95-c232-4d9e-8e96-c207b59f325b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076712 Aug 10 22:50:06.825843 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 208/425] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:50:07.447468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:07.448322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:07.455816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:07.456306 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:07.456742 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:07.457471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:07.457929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:07.458356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:07.614684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:07.622260 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-aae9baa0-efbe-4b60-adaf-540bbb131cba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.178507 Aug 10 22:50:07.622881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 218/426] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:07 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:07.848104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:07.849075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:07.869686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:07.870345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:07.870782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:07.871490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:07.871945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:07.872370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:07.906829 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:07.907320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:07.907759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:07.908199 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lazy-loading 'fault' on Instance uuid 1e75b766-2345-490e-85d7-f87c0b3faae3 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:50:07.910945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:07.954629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f645ba95eb64bb2b23d0d38a141307a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a0ee776f574f46bdb5f16c1b864402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:07.962557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-75053b69-2f6d-4a67-9795-7d0e28e72c1e tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 200 len: 1304 microversion: 2.1 time: 0.121759 Aug 10 22:50:07.963179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 209/427] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:07 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:08.644264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:08.644942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:08.651286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:08.651786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:08.653212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:08.654343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:08.655334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:08.656065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:08.843855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:08.851816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f694cc3f-4515-444b-843f-a345e0ccbe95 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1322 microversion: 2.1 time: 0.212262 Aug 10 22:50:08.852299 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 219/428] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:08 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:08.985785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:08.987050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] [instance: 1e75b766-2345-490e-85d7-f87c0b3faae3] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:08.995352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:08.995836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:08.996439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:08.997260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:08.997871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:08.998816 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:09.013809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] HTTP exception thrown: Instance 1e75b766-2345-490e-85d7-f87c0b3faae3 could not be found. Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Request method failure captured: Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 HTTP/1.1 Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DW2t3JAMJCEAhjTaX6u859wFPnNuZiVGvUM9ngPy5VWDKRgK-ana_S_NL9CaUgAJ0NovS8KD1hxZl2QLgJ8EFQhM1Kibvo0MXKbiEzlLUHjcyIaTY1HaSGe01W6rRh14jGEU-L069acC5HB7E8rDcpxD55RLSBQ2AfVsqXKLewA6GY Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 50a0ee776f574f46bdb5f16c1b864402 Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-VolumesActionsTest-217004922 Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:50:09.016021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/50a0ee776f574f46bdb5f16c1b864402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50a0ee776f574f46bdb5f16c1b864402"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_50a0ee776f574f46bdb5f16c1b864402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/50a0ee776f574f46bdb5f16c1b864402"}]}] Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-VolumesActionsTest-217004922 Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 50a0ee776f574f46bdb5f16c1b864402 Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-VolumesActionsTest-217004922 Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-VolumesActionsTest-217004922-project Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 0f645ba95eb64bb2b23d0d38a141307a Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-VolumesActionsTest-217004922-project Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 1e75b766-2345-490e-85d7-f87c0b3faae3 could not be found. Aug 10 22:50:09.017302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '1e75b766-2345-490e-85d7-f87c0b3faae3'} Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e75b766-2345-490e-85d7-f87c0b3faae3 could not be found. Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:50:09.018758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e75b766-2345-490e-85d7-f87c0b3faae3 could not be found. Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e75b766-2345-490e-85d7-f87c0b3faae3 could not be found. Aug 10 22:50:09.019936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:50:09.022836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] Returning 404 to user: Instance 1e75b766-2345-490e-85d7-f87c0b3faae3 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:50:09.022836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-806ff91b-647e-4d77-9d3d-e9fc84d68423 tempest-VolumesActionsTest-217004922 tempest-VolumesActionsTest-217004922-project] 10.222.0.76 "GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3" status: 404 len: 111 microversion: 2.1 time: 0.037024 Aug 10 22:50:09.022836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 210/429] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:08 2022] GET /compute/v2.1/servers/1e75b766-2345-490e-85d7-f87c0b3faae3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:50:09.876030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:09.877175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:09.884155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:09.884699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:09.885256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:09.886081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:09.886718 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:09.887514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:10.273680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:10.283052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ee457821-d920-4675-92ed-646366674b04 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1516 microversion: 2.1 time: 0.411988 Aug 10 22:50:10.283643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 220/430] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:09 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:10.310921 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:50:10.313887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:10.322128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:10.322836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:10.323281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:10.324017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:10.324634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:10.325197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:10.354409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lazy-loading 'flavor' on Instance uuid 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:50:10.478110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b9a8d264-f63c-4306-a909-81aa1229281d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2/action" status: 200 len: 32 microversion: 2.1 time: 0.171338 Aug 10 22:50:10.479013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 211/431] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:50:10 2022] POST /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:50:10.491777 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:10.492682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:10.500493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:10.502173 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:10.503059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:10.503908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:10.504364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:10.505406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:10.659904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:10.667586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-af7bbe80-c310-4b18-ac53-c59234dafadf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.182550 Aug 10 22:50:10.668155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 221/432] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:10 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:11.690111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:11.690882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:11.698198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:11.698708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:11.699158 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:11.699886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:11.700350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:11.700782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:11.854826 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:11.862859 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-15f1fd3e-ea24-4a4e-9bb0-f6d370c8245f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.178063 Aug 10 22:50:11.863570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 212/433] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:11 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:12.884969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:12.894502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:12.907905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:12.908632 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:12.909546 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:12.910456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:12.911070 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:12.911980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:13.168276 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:13.181008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-dcb6649f-f808-4cd0-887d-2bf99b5626de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.300620 Aug 10 22:50:13.191940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 222/434] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:12 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:14.204701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:14.206034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:14.217813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:14.218031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:14.220801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:14.221591 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:14.222237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:14.222821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:14.414606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:14.423459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e91a7b7c-ed37-420a-8653-9020da241640 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.222733 Aug 10 22:50:14.425444 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 213/435] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:14 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:15.446765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:15.447376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:15.454248 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:15.454654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:15.455110 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:15.455798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:15.456252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:15.456724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:15.625916 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:15.637234 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3ffba731-9645-4f98-8371-bf55cb098e9d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.194255 Aug 10 22:50:15.638135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 223/436] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:15 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:16.660073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:16.660720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:16.663682 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:16.674190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:16.675299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:16.676031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:16.677367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:16.678064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:16.678740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:16.958957 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:16.967911 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-eec72e98-81f9-4405-abb3-590e3a74f86f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.313586 Aug 10 22:50:16.968975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 214/437] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:16 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:17.990421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:17.991216 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:18.003793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:18.004324 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:18.004781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:18.005938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:18.006416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:18.006835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:18.277829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:18.298926 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-15739703-adfd-4b61-98d3-03b0859b6912 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.309948 Aug 10 22:50:18.301455 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 224/438] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:17 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:19.336289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:19.337388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:19.351883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:19.352561 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:19.353507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:19.354479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:19.355630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:19.358688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:19.678205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:19.698389 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-634cd4cc-9139-4299-a2d8-f3ac39141a5d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.365668 Aug 10 22:50:19.699749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 215/439] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:19 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:20.721395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:20.722931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:20.739673 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:20.740195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:20.740650 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:20.741406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:20.741873 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:20.742305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:20.938176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:20.956605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-90a961c7-50b2-4290-b28c-1349caafcc08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.238807 Aug 10 22:50:20.971340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 225/440] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:20 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:21.981185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:21.982409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:21.996677 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:21.997778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:21.999085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:22.000224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:22.001083 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:22.001897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:22.212138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:22.220302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b352da1a-36fe-408c-935f-701cf71d5070 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.245014 Aug 10 22:50:22.220875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 216/441] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:21 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:23.245199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:23.246142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:23.257452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:23.257951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:23.258441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:23.262155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:23.265744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:23.266531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:23.503159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:23.512448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1989e72e-bd1e-4242-993f-006f6d4e8466 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.272158 Aug 10 22:50:23.514190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 226/442] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:23 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:24.543623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:24.545224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:24.556339 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:24.556937 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:24.557411 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:24.558124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:24.558579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:24.559291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:24.717305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:24.724860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-816cb4b8-0023-4d8f-b0b0-14ff63da7da1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.185726 Aug 10 22:50:24.725683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 217/443] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:24 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:25.747940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:25.749375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:25.756164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:25.756960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:25.757653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:25.758583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:25.759038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:25.759463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:25.967228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:25.976867 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-98e73d12-0374-4951-957f-a83bcb4163aa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.233671 Aug 10 22:50:25.992874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 227/444] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:25 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:26.999978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:27.000746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:27.008087 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:27.008576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:27.009206 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:27.010164 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:27.010812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:27.011413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:27.195277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:27.207948 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5bec1b2f-e599-4743-8a5d-2004f8fafa59 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.212347 Aug 10 22:50:27.209061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 218/445] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:26 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:28.230921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:28.232992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:28.238438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:28.245418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:28.245924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:28.246371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:28.247924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:28.248721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:28.249157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:28.254720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:28.440145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:28.448050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c1eb955a-7901-433e-a28d-8ee74274ab90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.221525 Aug 10 22:50:28.449104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 228/446] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:28 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:29.473654 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:29.474472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:29.482613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:29.483678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:29.484149 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:29.484884 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:29.485432 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:29.485858 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:29.666913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:29.678936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-18b11679-3ab7-4dbd-b6c6-740a7b494594 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.213437 Aug 10 22:50:29.680748 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 219/447] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:29 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:30.700788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:30.701647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:30.708535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:30.709030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:30.709495 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:30.710407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:30.711012 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:30.711590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:30.906349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:30.926214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e9cb1da6-12e8-45c0-91a6-7a8a75c213c2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.229509 Aug 10 22:50:30.926657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 229/448] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:30 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:31.948218 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:31.948839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:31.960404 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:31.960905 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:31.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:31.973160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:31.973679 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:31.974317 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:32.154260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:32.162479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-99bc02f4-117d-4334-a40f-cf0f58a664cb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.218406 Aug 10 22:50:32.164667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 220/449] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:31 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:33.188001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:33.192177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:33.199141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:33.200583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:33.201141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:33.202040 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:33.202507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:33.203092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:33.516973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:33.534363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cd0e1094-9b8a-47d4-9b4b-22b37155b857 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.350743 Aug 10 22:50:33.538168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 230/450] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:33 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:34.561922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:34.563638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:34.572898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:34.574152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:34.575627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:34.576901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:34.579657 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:34.580380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:34.774012 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:34.782410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-458f5f25-8907-4656-856f-286d18126c16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.226322 Aug 10 22:50:34.807331 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 221/451] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:34 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:35.883068 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:35.884605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:35.899426 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:35.900487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:35.901179 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:35.904725 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:35.905655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:35.906350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:36.197966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:36.208373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d7a24e80-fbec-42cf-b089-1086e5ebb6a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.339711 Aug 10 22:50:36.215491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 231/452] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:35 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:37.247358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:37.248565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:37.255256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:37.255741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:37.256207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:37.256887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:37.257372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:37.257799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:37.440496 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:37.451671 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e6918433-9379-49a3-a102-7f646abf0799 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.208091 Aug 10 22:50:37.452685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 222/453] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:37 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:38.066604 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-be82f8b0-70fc-4377-af40-d8fae54c7edd tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Action: 'create', calling method: .version_select at 0x7fa9bea699d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1739506986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7t44ZkeZ3mONQR7NoCOQLFW8J4x2dN17pPolphoTLI3Wk4KVvG1anmIj8GxnzoDFKhBaejKbHksz0RnZe5iJBCxAeW/xhAkMx3cBOEDh9QA6sRDpphvmDzkC0J92fAiw=="}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:50:38.089316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-be82f8b0-70fc-4377-af40-d8fae54c7edd tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Getting quotas for project 0f4c72696c814e6e816fd9240569e0db. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:50:38.094721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-be82f8b0-70fc-4377-af40-d8fae54c7edd tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Getting quotas for user b9f5b7c7c05c42eda7926cd03a0fd9bc and project 0f4c72696c814e6e816fd9240569e0db. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:50:38.123137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-be82f8b0-70fc-4377-af40-d8fae54c7edd tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062644 Aug 10 22:50:38.124184 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 232/454] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:50:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:50:38.178781 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-704611271", "imageRef": "13b7fd87-16ea-4aa3-aa9d-39ea6a45efd7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1739506986", "networks": [{"uuid": "27ef480a-4a7d-412e-91d4-4246c8d1c7b9"}]}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:50:38.231457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] validate_networks() for [('27ef480a-4a7d-412e-91d4-4246c8d1c7b9', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:50:38.474937 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:38.475466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:38.482410 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:38.482902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:38.483343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:38.484043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:38.484499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:38.484927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:38.664232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:50:38.664695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:50:38.665105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:50:38.665577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:50:38.665984 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:50:38.675295 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:38.675773 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:38.676205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:38.676926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:38.677405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:38.677859 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:38.686833 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:38.687732 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:38.695541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ef3adc59-c536-43d3-84e3-4df9674eb6a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.224685 Aug 10 22:50:38.696116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 233/455] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:38 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:38.699163 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Getting quotas for project 0f4c72696c814e6e816fd9240569e0db. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:50:38.704003 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Getting quotas for user b9f5b7c7c05c42eda7926cd03a0fd9bc and project 0f4c72696c814e6e816fd9240569e0db. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:50:38.714722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:50:38.716881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13b7fd87-16ea-4aa3-aa9d-39ea6a45efd7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:50:38.763352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-176210e4-dc6e-4139-9768-cc8a893b5073 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588489 Aug 10 22:50:38.763932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 223/456] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 22:50:38.774573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ef0eb5e3-1293-422f-846f-e969dea6d0d8 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:38.775188 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ef0eb5e3-1293-422f-846f-e969dea6d0d8 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:38.831118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ef0eb5e3-1293-422f-846f-e969dea6d0d8 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:38.837690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ef0eb5e3-1293-422f-846f-e969dea6d0d8 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1258 microversion: 2.1 time: 0.066937 Aug 10 22:50:38.838251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 234/457] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:38 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:39.718227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:39.719554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:39.726742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:39.727491 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:39.728147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:39.728874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:39.729553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:39.730000 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:39.860317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:39.864031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:39.881463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:39.883242 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:39.885455 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:39.886624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:39.887333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:39.888645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:40.182458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:40.203978 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e28dec34-52b7-4da9-9cb0-3973fde6ab07 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1310 microversion: 2.1 time: 0.349332 Aug 10 22:50:40.208405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 235/458] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:39 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1310 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:40.211222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:40.221353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-969d31c3-51c9-49ed-a975-47f9682aeb90 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.508297 Aug 10 22:50:40.224188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 224/459] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:39 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:41.227473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:41.228118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:41.234842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:41.235271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:41.235712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:41.236430 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:41.236860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:41.237313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:41.250991 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:41.251695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:41.257996 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:41.258476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:41.258910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:41.259593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:41.260044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:41.260467 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:41.300997 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:41.309926 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ea5f00cb-ee8b-4fb0-940a-7e55f13dbc78 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1328 microversion: 2.1 time: 0.085987 Aug 10 22:50:41.310514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 236/460] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:41 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:41.399647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:41.411030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7b298504-4d8c-4fa6-8939-335f705c6334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.163636 Aug 10 22:50:41.412365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 225/461] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:41 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:42.331421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:42.332140 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:42.341984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:42.342487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:42.342924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:42.343689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:42.344093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:42.346112 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:42.438143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:42.439734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:42.448506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:42.455103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:42.461315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:42.463980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:42.467207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:42.470877 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:42.833319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:42.842482 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f76a1173-57f4-4039-a767-01f14018b07d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.515424 Aug 10 22:50:42.846114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 237/462] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:42 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:42.876250 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:42.885991 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5ec94279-0ec6-41a5-b6b9-a1d2acacf2ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.451023 Aug 10 22:50:42.887280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 226/463] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:42 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:43.253960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-d175ff2e-0085-4a2d-84d0-ddd9b7e3fe1c req-f8229988-e82f-48d4-b029-baa8b1ce4f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76249cfc-607a-42b8-b469-f9ece621ff37", "tag": "474d9c74-6ea7-4b7f-baf3-afc458023ff1"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:50:43.267349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d175ff2e-0085-4a2d-84d0-ddd9b7e3fe1c req-f8229988-e82f-48d4-b029-baa8b1ce4f45 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:43.267959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d175ff2e-0085-4a2d-84d0-ddd9b7e3fe1c req-f8229988-e82f-48d4-b029-baa8b1ce4f45 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:43.268724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d175ff2e-0085-4a2d-84d0-ddd9b7e3fe1c req-f8229988-e82f-48d4-b029-baa8b1ce4f45 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:43.288579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-d175ff2e-0085-4a2d-84d0-ddd9b7e3fe1c req-f8229988-e82f-48d4-b029-baa8b1ce4f45 service nova] Creating event network-changed:474d9c74-6ea7-4b7f-baf3-afc458023ff1 for instance 76249cfc-607a-42b8-b469-f9ece621ff37 on hv-cinder-83608 Aug 10 22:50:43.294534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-d175ff2e-0085-4a2d-84d0-ddd9b7e3fe1c req-f8229988-e82f-48d4-b029-baa8b1ce4f45 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045280 Aug 10 22:50:43.296115 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 238/464] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:50:43.866061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:43.866679 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:43.873927 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:43.874422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:43.874841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:43.875526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:43.875972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:43.876389 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:43.923117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:43.923842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:43.929887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:43.930376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:43.930817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:43.931510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:43.932162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:43.932753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:44.050918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:44.063542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-208d32e6-ffc2-4201-8550-4bd17a676e72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.201114 Aug 10 22:50:44.075048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 227/465] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:43 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:44.103550 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:44.104056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:44.110821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:44.111320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:44.111790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:44.112497 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:44.113037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:44.113496 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:44.116711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:44.124973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e6e31d13-bbb8-4f44-a2a8-b11d4392c901 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.207352 Aug 10 22:50:44.141584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 239/466] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:43 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:44.250492 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lazy-loading 'services' on Instance uuid 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:50:44.377450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9b06290b-f375-451b-9378-c3a5def72c32 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0/os-volume_attachments/0b49fb87-6038-4603-bf14-f97d16ac430e" status: 202 len: 0 microversion: 2.1 time: 0.279627 Aug 10 22:50:44.378381 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 228/467] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:50:44 2022] DELETE /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0/os-volume_attachments/0b49fb87-6038-4603-bf14-f97d16ac430e => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:50:45.084120 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:45.084640 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:45.091408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:45.091897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:45.092336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:45.093032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:45.093527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:45.093953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:45.149265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:45.150101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:45.157247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:45.157907 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:45.158792 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:45.159256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:45.159699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:45.160296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:45.284964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:45.296888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2025cdd6-1522-4c6b-8bb7-928c29623df2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.216715 Aug 10 22:50:45.298143 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 240/468] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:45 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:45.350160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:45.359244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-499a36f9-fa0d-4934-9c47-a7011fec5397 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.214751 Aug 10 22:50:45.359950 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 229/469] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:45 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:46.332397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:46.333010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:46.343629 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:46.348685 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:46.349205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:46.350424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:46.350896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:46.351813 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:46.380152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:46.380764 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:46.392843 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:46.393433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:46.393898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:46.394642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:46.395100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:46.395529 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:46.747386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:46.755433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-735fb807-3ffc-4a86-8dc7-1a83df72a95c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.379296 Aug 10 22:50:46.756007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 230/470] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:46 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:46.762987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:46.772307 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0473473b-8c20-4373-8664-b43a5efbf6c1 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.456762 Aug 10 22:50:46.773140 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 241/471] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:46 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:47.779922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:47.780585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:47.783065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:47.788610 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:47.789106 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:47.789842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:47.790741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:47.791362 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:47.792088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:47.793692 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:47.794625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:47.801060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:47.801844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:47.802477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:47.803321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:47.804147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:47.804714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:48.094968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:48.104960 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cd467311-8dd7-46ab-98f7-3fb4f3607579 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.329849 Aug 10 22:50:48.105963 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 231/472] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:47 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:48.137597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:48.146086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f24eb064-8255-4ebe-a697-97756c0d5085 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.356622 Aug 10 22:50:48.147211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 242/473] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:47 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:49.127004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:49.128179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:49.130049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:49.130874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=6 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:49.137775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:49.138268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:49.138709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:49.139413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:49.139866 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:49.140294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:49.168898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:49.169786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:49.171745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=6 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:49.177576 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:49.178088 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:49.178533 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:49.179339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:49.179837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:49.180272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:49.375869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:49.380075 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:49.383740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7cd5d8a3-0a91-456c-a40f-7a14965c1800 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.260455 Aug 10 22:50:49.392844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 232/474] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:49 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:49.393054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-84798b82-98eb-43a3-8c96-d9901c8906cb tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.223636 Aug 10 22:50:49.393054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 243/475] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:49 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:50.409099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:50.411125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:50.414575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:50.415732 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:50.422424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:50.422722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:50.423438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:50.423724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:50.423877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:50.424591 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:50.424780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:50.425419 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:50.425940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:50.426100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:50.427175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:50.427903 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:50.649108 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:50.653030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:50.659621 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-93d462e5-24da-45a3-a833-4feb8841e551 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.248784 Aug 10 22:50:50.660743 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 244/476] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:50 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:50.672064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3d692a9a-7c39-463b-aff4-a939cd79939a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.269675 Aug 10 22:50:50.672658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 233/477] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:50 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:51.687663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:51.688304 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:51.694443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:51.694948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:51.695405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:51.696149 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:51.696640 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:51.697066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:51.699428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:51.700429 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:51.707057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:51.707663 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:51.708204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:51.708981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:51.709541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:51.710005 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:51.906042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:51.908035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:51.913569 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a6f6994d-bd93-49cd-8d69-ad116ea642b8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.219103 Aug 10 22:50:51.914521 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 234/478] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:51 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:51.916148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-eb83147d-7bf9-4e19-bb2a-388b51447929 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.232378 Aug 10 22:50:51.916751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 245/479] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:51 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:52.935741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:52.936358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:52.937320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:52.939825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:52.943006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:52.943566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:52.944142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:52.944866 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:52.945339 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:52.945964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:52.948477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:52.949328 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:52.949917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:52.950956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:52.951681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:52.952266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:53.212245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:53.221741 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-72b208ea-6a01-4052-af1f-3541718edf6c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.289152 Aug 10 22:50:53.222480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 246/480] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:52 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:53.254080 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:53.262579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bfe90851-9ae2-4bc0-849d-3b225f425e3c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.331773 Aug 10 22:50:53.266015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 235/481] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:52 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:53.441637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 22:50:53.442042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 22:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 22:50:54.243988 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:54.244658 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:54.252158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:54.252654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:54.253092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:54.253830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:54.254278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:54.254890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:54.278147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:54.284014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:54.284742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:54.295616 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:54.296655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:54.296655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:54.297237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:54.297710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:54.298132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:54.513707 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:54.521268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7172e1ca-7fa7-40e1-92a0-17f736b1e283 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.281292 Aug 10 22:50:54.535549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 247/482] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:54 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:54.871100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:54.886940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c07fdf81-bcc3-4b5c-8249-b63fa185f1cf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.607218 Aug 10 22:50:54.897509 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 236/483] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:54 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:55.544608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:55.545247 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:55.556496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:55.557562 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:55.558364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:55.559171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:55.559634 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:55.560065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:55.840975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:55.849318 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6a127fd0-bbaa-4deb-8f20-d7e580cfac21 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.310071 Aug 10 22:50:55.857830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 248/484] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:55 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:55.911747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:55.912378 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:55.920359 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:55.920860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:55.921342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:55.922266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:55.922729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:55.923158 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:56.158350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:56.167660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-257caf61-6554-4872-bc13-fe06951c1d67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.261164 Aug 10 22:50:56.182609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 237/485] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:55 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:56.871897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:56.872609 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:56.882274 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:56.882831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:56.883329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:56.884132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:56.884836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:56.886543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:57.072469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:57.081719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0b27e3ad-2254-408c-be81-593317598b0b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.214709 Aug 10 22:50:57.082890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 249/486] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:56 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:57.191213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:57.192537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:57.205314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:57.206407 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:57.207316 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:57.209863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:57.211042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:57.212380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:57.401233 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:57.414230 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-93d85e25-ab31-4296-a359-db2abe7681a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.228367 Aug 10 22:50:57.429025 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 238/487] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:57 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:58.108563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:58.109169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:58.118055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:58.123197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:58.126001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:58.126943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:58.129619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:58.130394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:58.320843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:58.332760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-86053e51-58b2-45c7-9b37-9d0cef0b589a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.228596 Aug 10 22:50:58.334531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 250/488] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:58 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:58.450512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:58.454455 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:58.467100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:58.473552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:58.474230 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:58.475156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:58.475769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:58.476355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:58.705339 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:58.707581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:58.728254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d749eabc-6520-4651-96a0-5a20d4bbf680 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.295241 Aug 10 22:50:58.730756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 239/489] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:58 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:50:59.360656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:59.362911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:59.372920 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:50:59.374900 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:59.375675 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:59.376521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:59.378655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:59.379715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:59.380353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:59.588733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:50:59.601177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-27fce56d-412f-449c-b987-d529442c8b3f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.249712 Aug 10 22:50:59.602093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 251/490] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:59 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:50:59.754912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:50:59.756208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:50:59.765335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:59.766047 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:59.766439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:50:59.767292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:50:59.767749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:50:59.768191 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:00.194125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:00.204289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-35e9e592-1b37-4995-a7bb-2e38688763d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.453926 Aug 10 22:51:00.221899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 240/491] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:50:59 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:00.626805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:00.628138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:00.641544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:00.642053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:00.642490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:00.645739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:00.647063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:00.647500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:00.877175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:00.886850 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8bc7f31f-ef37-4502-8db3-c0fdc5743e55 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.265567 Aug 10 22:51:00.887619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 252/492] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:00 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:01.234325 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:01.235696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:01.253475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:01.257455 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:01.258150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:01.259075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:01.260382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:01.261882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:01.534824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:01.547068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c641ef1b-2cca-4225-991f-4f4310f30334 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.324949 Aug 10 22:51:01.568779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 241/493] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:01 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:01.860747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:01.862395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:01.869640 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:01.870477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:01.871169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:01.872756 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:01.873752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:01.874413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:01.908345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:01.909698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:01.919741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:01.921822 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:01.923374 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:01.924638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:01.925183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:51:01.927728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:01.929320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:02.118587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-206770c5-1a7b-4f6a-8c5b-6bd84f75b7d3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 204 len: 0 microversion: 2.1 time: 0.262615 Aug 10 22:51:02.122569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 253/494] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:51:01 2022] DELETE /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:51:02.143229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:02.144970 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:02.152902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:02.153764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:02.154408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:02.155416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:02.156085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:02.156855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:02.339432 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:02.347976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-49b54c53-3988-4ca3-a3fc-b707d956edba tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.443797 Aug 10 22:51:02.349082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 242/495] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:01 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:02.444449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:02.454927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-008d739a-47f3-472e-86c8-e957b88674bd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1515 microversion: 2.1 time: 0.326321 Aug 10 22:51:02.455523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 254/496] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:02 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:02.575980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:02.576813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:02.592757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:02.594073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:02.595726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:02.596818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:02.599410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:02.599939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:02.842707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:02.852642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a71fb839-12af-4334-b2cd-85cc49e6e71c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.281047 Aug 10 22:51:02.853267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 243/497] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:02 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:03.372105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:03.373670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:03.395395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:03.396697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:03.397967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:03.400778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:03.405960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:03.407965 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:03.479352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:03.481055 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:03.497705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:03.498650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:03.499639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:03.500640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:03.501520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:03.502191 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:03.894103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:03.904405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7cd8082b-f451-4442-a588-00b549d0ebc6 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1515 microversion: 2.1 time: 0.430714 Aug 10 22:51:03.905446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 244/498] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:03 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:03.911115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:03.911981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:03.920595 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:03.921449 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:03.922913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:03.923613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:03.925355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:03.926234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:03.926885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:03.930304 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-98d6f3d3-fe0d-47f7-9ac6-32bd3c2dea3d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.564022 Aug 10 22:51:03.932447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 255/499] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:03 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:04.146186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:04.156805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-30bce46c-f5c7-4866-9699-1614423ada40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.249484 Aug 10 22:51:04.159705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 245/500] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:03 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:04.929374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:04.930691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:04.939839 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:04.940751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:04.941468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:04.943277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:04.944366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:04.945591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:04.953219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:04.954691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:04.970740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:04.971434 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:04.971974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:04.972800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:04.973613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:04.974539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:05.299131 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:05.304699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:05.308197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-06fed9ae-7ff6-464c-ad4c-782b6083aa13 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1515 microversion: 2.1 time: 0.385149 Aug 10 22:51:05.315436 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ad2977d3-c13b-4e88-a717-ef3c6641a5f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.366727 Aug 10 22:51:05.321260 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 256/501] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:04 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:05.323726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 246/502] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:04 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:05.327614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:05.328921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:05.335443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:05.335922 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:05.336627 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:05.338047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:05.338739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:05.339161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:05.582238 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:05.597123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8baad278-8cf4-4b80-a491-0e308754d955 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.274132 Aug 10 22:51:05.607515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 257/503] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:05 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:06.027944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1a15b492-827b-4c23-bfb3-22a07bc9552f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Action: 'create', calling method: .version_select at 0x7fa9be701ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1946085716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOjiLW+QmL4f7N6IIGFCNyW2UufCKUxXBym/1E/1Uf+Ky3PpuuHPUS6ZKbAGGBoLVwGXfHMuc6dOp8lMEoj+4CW6a3xsTu7TK1RHDOVK4NAZPQjiKCkNVFqUwfHUhkUMw=="}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:06.044003 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-1a15b492-827b-4c23-bfb3-22a07bc9552f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Getting quotas for project 2df73c10b6654d47a921aa6866d81526. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:51:06.048180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-1a15b492-827b-4c23-bfb3-22a07bc9552f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Getting quotas for user f5fe2bdd1ea54f8cba4d100b26c18464 and project 2df73c10b6654d47a921aa6866d81526. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:51:06.074597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1a15b492-827b-4c23-bfb3-22a07bc9552f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.229966 Aug 10 22:51:06.080869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 247/504] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:51:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:06.329317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:06.330264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:06.336560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:06.336850 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:06.337563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:06.337914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:06.338624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:06.339695 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:06.340688 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:06.341227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:06.345589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:06.346298 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:06.346723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:06.347433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:06.347879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:06.348294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:06.570991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:06.580864 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:06.589153 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6835af70-783a-4a50-b388-af51260dbcc3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1515 microversion: 2.1 time: 0.263465 Aug 10 22:51:06.590372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 258/505] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:06 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:06.590891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3c8a422f-df37-47f4-b81f-d8301275011e tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.258567 Aug 10 22:51:06.591674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 248/506] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:06 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:06.620237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:06.620845 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:06.627507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:06.628283 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:06.628862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:06.629650 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:06.630103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:06.630530 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:06.772961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:06.781692 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-702a2995-2837-41ed-a92c-f6ade8108337 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1522 microversion: 2.1 time: 0.165353 Aug 10 22:51:06.782113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 259/507] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:06 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:07.612345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:07.612853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:07.614868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:07.615515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:07.620349 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:07.620832 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:07.621258 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:07.621972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:07.622226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:07.622434 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:07.622714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:07.622820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:07.623150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:07.623849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:07.624308 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:07.624736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:07.832873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:07.848364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:07.849121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f6f91761-4490-45d4-a519-771104bf3666 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1515 microversion: 2.1 time: 0.238089 Aug 10 22:51:07.849759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 260/508] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:07 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:07.856320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:07.857254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:07.864485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:07.865052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:07.865575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:07.865805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fd823dff-e219-4aaa-8620-8d8a018a1c22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.257354 Aug 10 22:51:07.866372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:07.867166 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:07.867282 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 249/509] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:07 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:07.867362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.044783 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:08.053579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-eab7749f-a6f8-49f7-8fd0-31e8f423675a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1502 microversion: 2.1 time: 0.202030 Aug 10 22:51:08.065584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 261/510] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:07 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:08.075166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:08.075894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:08.084993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.085949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.086437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.087796 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.088537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.088975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.269111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:08.278614 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8deb813a-45a3-4375-a005-0019fe8d73d3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1517 microversion: 2.1 time: 0.207365 Aug 10 22:51:08.279203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 250/511] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:08 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:08.664335 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-49a5c367-384e-4efb-a1ee-e1605c61007e req-428fa9e7-fec6-4a48-a98f-e7b51eab7248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edeaacb-3fb5-4dff-8e69-2b35d58fbad0", "name": "network-vif-deleted", "tag": "778467ad-ffb4-4238-89cb-87ab191cb39e"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:08.691412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-49a5c367-384e-4efb-a1ee-e1605c61007e req-428fa9e7-fec6-4a48-a98f-e7b51eab7248 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.693706 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-49a5c367-384e-4efb-a1ee-e1605c61007e req-428fa9e7-fec6-4a48-a98f-e7b51eab7248 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.694628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-49a5c367-384e-4efb-a1ee-e1605c61007e req-428fa9e7-fec6-4a48-a98f-e7b51eab7248 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.742152 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-49a5c367-384e-4efb-a1ee-e1605c61007e req-428fa9e7-fec6-4a48-a98f-e7b51eab7248 service nova] Creating event network-vif-deleted:778467ad-ffb4-4238-89cb-87ab191cb39e for instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 on hv-cinder-83608 Aug 10 22:51:08.756610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-49a5c367-384e-4efb-a1ee-e1605c61007e req-428fa9e7-fec6-4a48-a98f-e7b51eab7248 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096094 Aug 10 22:51:08.760645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 262/512] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:08.874283 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:08.874962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:08.883140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.883907 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.884671 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.885876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.886616 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.887268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.891382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:08.893989 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:08.905149 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.905954 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.906583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.907659 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.909439 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.910665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.919792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:08.934572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:08.935045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:08.935490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:08.935947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lazy-loading 'fault' on Instance uuid 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:51:08.997749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:09.009476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-59be1df8-d016-468f-abb3-d5555649dbc8 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 200 len: 1309 microversion: 2.1 time: 0.141320 Aug 10 22:51:09.010478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 251/513] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:08 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:09.140343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:09.149864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bfcf022d-a3e4-4be6-b0ea-da886db867f2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.264673 Aug 10 22:51:09.150909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 263/514] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:08 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:09.933835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:09.936130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:09.942738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:09.943223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:09.943657 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:09.944366 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:09.944822 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:09.945248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:09.971773 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lazy-loading 'flavor' on Instance uuid 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:51:10.035592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:10.036212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:10.043310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:10.043882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:10.044386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:10.045126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:10.045564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:10.045992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:10.054186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b0730270-c022-4ee4-a2d0-41737c2f84c8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447/action" status: 200 len: 32 microversion: 2.1 time: 0.124317 Aug 10 22:51:10.056051 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 252/515] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:51:09 2022] POST /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447/action => generated 32 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:51:10.065541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] HTTP exception thrown: Instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 could not be found. Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Request method failure captured: Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 HTTP/1.1 Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DW2WPnjkpt7gUVzfwRog8RYklbV_zuO6YAgG3ajNTyDSGM1ofLhJyO1uD179JAgPX7DTVBcvrPq60f4jPNEw4t6UWlo9C_ew3uwG_4UxQHdwJXb19HtM1QaVOfuMrZ8wcv_iWWyZPm7bSXy3kNguJbJeGP27oDBlrm-Ud59J4KOG4w Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: c38d0effe2b242bbb7ea221ec2da0177 Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesSnapshotTestJSON-541983790 Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:51:10.067374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c38d0effe2b242bbb7ea221ec2da0177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c38d0effe2b242bbb7ea221ec2da0177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c38d0effe2b242bbb7ea221ec2da0177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c38d0effe2b242bbb7ea221ec2da0177"}]}] Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesSnapshotTestJSON-541983790 Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: c38d0effe2b242bbb7ea221ec2da0177 Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-541983790 Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesSnapshotTestJSON-541983790-project Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 0f3c2f531a5942e6afabb16521523754 Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesSnapshotTestJSON-541983790-project Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 could not be found. Aug 10 22:51:10.069000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '4edeaacb-3fb5-4dff-8e69-2b35d58fbad0'} Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 could not be found. Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:51:10.069933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 could not be found. Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 could not be found. Aug 10 22:51:10.072492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:51:10.074415 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:10.074415 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:10.075582 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Returning 404 to user: Instance 4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:51:10.076658 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-41aa6954-235f-4eff-a281-d1ba8386c334 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0" status: 404 len: 111 microversion: 2.1 time: 0.044978 Aug 10 22:51:10.077759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 264/516] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:10 2022] GET /compute/v2.1/servers/4edeaacb-3fb5-4dff-8e69-2b35d58fbad0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:51:10.086009 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:10.088606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:10.088968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:10.092751 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:10.093560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:10.094153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:10.173125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:10.173938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:10.190223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:10.192076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:10.193830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:10.196799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:10.197401 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:10.198893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:10.462770 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:10.470724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-74705621-79f5-4427-8371-02e16923f36d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.408453 Aug 10 22:51:10.471298 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 253/517] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:10 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:10.496081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:10.504162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-03cf168f-44e2-40ea-a7f1-945ad378dc4a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.335797 Aug 10 22:51:10.504762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 265/518] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:10 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:10.920629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-e8313184-93f8-4bf5-a600-d1342049d865 req-2659b29e-489c-4db8-8e5b-f2c8ba720a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76249cfc-607a-42b8-b469-f9ece621ff37", "name": "network-vif-plugged", "status": "completed", "tag": "474d9c74-6ea7-4b7f-baf3-afc458023ff1"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:10.938588 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e8313184-93f8-4bf5-a600-d1342049d865 req-2659b29e-489c-4db8-8e5b-f2c8ba720a73 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:10.940760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e8313184-93f8-4bf5-a600-d1342049d865 req-2659b29e-489c-4db8-8e5b-f2c8ba720a73 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:10.941192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e8313184-93f8-4bf5-a600-d1342049d865 req-2659b29e-489c-4db8-8e5b-f2c8ba720a73 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:10.957205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-e8313184-93f8-4bf5-a600-d1342049d865 req-2659b29e-489c-4db8-8e5b-f2c8ba720a73 service nova] Creating event network-vif-plugged:474d9c74-6ea7-4b7f-baf3-afc458023ff1 for instance 76249cfc-607a-42b8-b469-f9ece621ff37 on hv-cinder-83608 Aug 10 22:51:10.962411 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-e8313184-93f8-4bf5-a600-d1342049d865 req-2659b29e-489c-4db8-8e5b-f2c8ba720a73 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046735 Aug 10 22:51:10.963736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 254/519] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:51:11.493882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:11.495060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:11.502063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:11.502560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:11.503008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:11.503714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:11.504168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:11.504592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:11.526952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:11.527646 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:11.533944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:11.534427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:11.534861 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:11.535577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:11.536009 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:11.536432 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:11.937209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:11.941567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:11.943987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:11.945001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1da5205c-0a6b-44ef-82d0-67fd767d7593 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.455990 Aug 10 22:51:11.945862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 266/520] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:11 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:11.951723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d3d49a6f-c40b-4fb9-bd81-2ba34ea28e3b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.428926 Aug 10 22:51:11.952285 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 255/521] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:11 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:12.967232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:12.968069 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:12.976450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:12.977541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:12.978995 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:12.979539 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:12.980054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:12.980829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:12.981308 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:12.981980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:12.988755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:12.989612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:12.990341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:12.991526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:12.992291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:12.993201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:13.204573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:13.211500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:13.212723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3eb27739-9e30-43ae-a5ed-61702e2d9cac tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.249426 Aug 10 22:51:13.213338 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 267/522] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:12 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:13.219593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cb11a01e-c554-4edf-9ea3-837cb69a1f72 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.251017 Aug 10 22:51:13.220153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 256/523] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:12 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:14.233511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:14.233511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:14.240116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:14.240626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:14.240770 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:14.241114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:14.241584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:14.242286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:14.243301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:14.243728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:14.248089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:14.248580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:14.249019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:14.249746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:14.250202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:14.250627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:14.450597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:14.460672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:14.463915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-db5554ac-4d4e-4db3-abd2-8b43355b6d06 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.234267 Aug 10 22:51:14.464535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 268/524] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:14 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:14.469002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ed5fda7e-fbfe-4bd4-a3c3-2e253d8715c4 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.232681 Aug 10 22:51:14.469594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 257/525] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:14 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:15.486415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:15.487032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:15.490063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:15.490828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:15.493888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:15.494378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:15.494820 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:15.495528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:15.495981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:15.496407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:15.498555 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:15.499045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:15.499484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:15.500188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:15.500740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:15.507024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:15.702516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:15.710121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8b1eceea-c270-4543-bc72-d8a2e974ec10 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.227772 Aug 10 22:51:15.710697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 269/526] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:15 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:15.714849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:15.722746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f899b031-1609-4754-a8bc-2236e1fa417c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.236435 Aug 10 22:51:15.723508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 258/527] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:15 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:16.734977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:16.736481 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:16.744856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:16.745370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:16.745815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:16.746521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:16.747124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:16.747927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:16.748163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:16.755198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:16.757414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:16.764152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:16.764725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:16.765236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:16.766027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:16.766697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:16.767186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:16.956823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:16.964799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e2cc45ea-624c-4342-9a0a-bea905585d08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.234299 Aug 10 22:51:16.965198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:16.966142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 270/528] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:16 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:16.973119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9b9c8899-46fa-4207-971e-88cacf94c476 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.232548 Aug 10 22:51:16.973707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 259/529] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:16 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:17.986208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:17.986823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:17.992967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:17.993270 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:17.993700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:17.993928 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:17.994031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:17.994618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:17.995070 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:17.995499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:17.996258 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:18.001423 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:18.001917 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:18.002359 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:18.003064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:18.003523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:18.003951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:18.197047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:18.200170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:18.205698 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-063b384a-0c82-4e76-8fb5-096bb6d4540a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.223366 Aug 10 22:51:18.206267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 271/530] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:17 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:18.208070 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-aa981de4-c9c5-4b1d-b92f-9afaa30e6018 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.218908 Aug 10 22:51:18.208776 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 260/531] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:17 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:19.229976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:19.230676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:19.231863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:19.232475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:19.238533 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:19.238698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:19.239024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:19.239326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:19.239533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:19.239968 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:19.240153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:19.240587 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:19.241007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:19.241192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:19.241834 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:19.242985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:19.450694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:19.460749 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:19.463485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4736ffa5-d900-4a0f-ad95-0c37d9695676 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1358 microversion: 2.1 time: 0.235565 Aug 10 22:51:19.464074 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 261/532] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:19 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:19.469961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-670e7323-c527-4ee3-a109-8daafa038f6e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.246428 Aug 10 22:51:19.470953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 272/533] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:19 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:20.485873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:20.486484 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:20.491258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:20.492037 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:20.494307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.494803 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.495246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.495975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.496414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.496843 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.498687 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.499246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.499603 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.500285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.500733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.501149 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.692658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:20.698145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:20.700559 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7ce45511-bd8a-44ae-8082-88b566264e88 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1547 microversion: 2.1 time: 0.218547 Aug 10 22:51:20.701374 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 262/534] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:20 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1547 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:20.706174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d469ca9a-b972-44ea-8673-63ab07dac032 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.218717 Aug 10 22:51:20.706948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 273/535] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:20 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:20.720536 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:20.721162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:20.727600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.728080 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.728506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.729204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.729682 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.730107 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.862744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:20.870362 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5e4b320c-34a7-41e9-9911-5ad0d1ebbf2f tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1547 microversion: 2.1 time: 0.153538 Aug 10 22:51:20.870938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 263/536] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:20 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:20.889774 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:20.894474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:20.895232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Searching by: {'deleted': False, 'project_id': '0f4c72696c814e6e816fd9240569e0db'} {{(pid=132540) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 22:51:20.902269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.902745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.903180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.903899 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:20.904549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:20.904757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:20.994879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.multi_cell_list [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 22:51:21.092734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-89eb421e-6ae9-4b75-83fa-dd85d31c837a tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206863 Aug 10 22:51:21.093345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 274/537] 10.222.0.76 () {58 vars in 1125 bytes} [Wed Aug 10 22:51:20 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:21.104695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:21.105344 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:21.111728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:21.112453 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:21.113061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:21.114022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:21.114483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:21.114909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:21.253637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:21.261256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-afb8efd5-9013-4bc2-a433-037a3c872fef tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1547 microversion: 2.1 time: 0.160652 Aug 10 22:51:21.261844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 264/538] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:21 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:21.730407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:21.730935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:21.736865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:21.737379 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:21.737821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:21.738546 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:21.738998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:21.739425 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:21.871256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:21.878562 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3e96e5fb-e9c9-427d-bf20-c96d41c88926 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.153114 Aug 10 22:51:21.879123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 275/539] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:21 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:22.899320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:22.899924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:22.906404 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:22.906887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:22.907319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:22.908016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:22.908463 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:22.908886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:23.046403 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:23.054001 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-24e17eb7-f982-473f-be06-5f233c2fc3a5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.158780 Aug 10 22:51:23.055317 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 265/540] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:22 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:24.077480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:24.078091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:24.084261 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:24.084745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:24.085184 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:24.086002 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:24.086456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:24.086879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:24.217401 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:24.224747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-00690a2b-9530-4d6e-9a4b-46ca30ff0351 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.151949 Aug 10 22:51:24.225321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 276/541] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:24 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:25.246422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:25.247034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:25.253251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:25.253774 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:25.254243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:25.254941 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:25.255401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:25.255832 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:25.392216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:25.400165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-554d1da3-934b-4994-a8b0-61857246a815 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.157671 Aug 10 22:51:25.400686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 266/542] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:25 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:26.290969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-23610294", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "networks": [{"uuid": "36b5ad33-0d5e-4960-96b9-1be5cca12db2"}]}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:26.343243 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] validate_networks() for [('36b5ad33-0d5e-4960-96b9-1be5cca12db2', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:51:26.422847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:26.423492 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:26.430867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:26.431379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:26.431821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:26.432537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:26.433556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:26.433663 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:26.650820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:26.658225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6b485b4c-5631-4441-b174-b0ebb9c2948e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.240186 Aug 10 22:51:26.658798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 267/543] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:26 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:26.782135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:51:26.782583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:51:26.783049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:51:26.783453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:51:26.783869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:51:26.794786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:26.795262 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:26.795691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:26.796434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:26.796882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:26.797316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:26.815851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Getting quotas for project c38d0effe2b242bbb7ea221ec2da0177. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:51:26.819799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Getting quotas for user 0f3c2f531a5942e6afabb16521523754 and project c38d0effe2b242bbb7ea221ec2da0177. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:51:26.831413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:51:26.833679 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:51:26.878985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a439264d-2c4d-4c51-92f3-8d03ea52d612 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591732 Aug 10 22:51:26.879843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 277/544] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:51:26.892192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-88e2385e-b769-4bdc-ab2e-f36175072659 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:26.892966 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-88e2385e-b769-4bdc-ab2e-f36175072659 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:26.964059 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-88e2385e-b769-4bdc-ab2e-f36175072659 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:26.971160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-88e2385e-b769-4bdc-ab2e-f36175072659 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1217 microversion: 2.1 time: 0.083055 Aug 10 22:51:26.971925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 268/545] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:26 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:27.052173 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb164cc4-f564-434d-a0a5-a2b152e5265a"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:27.056129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:27.063951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:27.064437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:27.064872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:27.065684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:27.066213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:27.066747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:27.680506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:27.681247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:27.687817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:27.688232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:27.688666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:27.689417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:27.689873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:27.690297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:27.828919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:27.837157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c1710d4c-12fd-42db-9d1d-1aa45eb11622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.160675 Aug 10 22:51:27.837806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 269/546] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:27 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:27.992036 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:27.992557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:27.998413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:27.998886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:27.999317 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:27.999996 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:28.000447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:28.000867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:28.071727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:28.079097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-034d192f-641d-4bc5-b745-9d2d8fed94dd tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1221 microversion: 2.1 time: 0.090935 Aug 10 22:51:28.079657 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 270/547] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:27 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:28.858301 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:28.859570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:28.867069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:28.868242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:28.869507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:28.870449 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:28.870925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:28.871361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:28.981645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1b3fb95c-8260-4c60-876c-74f3a2281330 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.933802 Aug 10 22:51:28.988193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 278/548] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:51:27 2022] POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments => generated 194 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:29.032997 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:29.041813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d0b55f88-8fa3-434c-8004-7729dab9d377 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.186934 Aug 10 22:51:29.044019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 271/549] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:28 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:29.101931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:29.102635 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:29.109031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:29.109792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:29.110038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:29.110827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:29.111307 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:29.111773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:29.130493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:29.180418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:29.187851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-20584b9e-da30-429b-a7bc-fa006b3c35ca tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1269 microversion: 2.1 time: 0.091259 Aug 10 22:51:29.188403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 279/550] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:29 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:30.064964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:30.065613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:30.072403 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:30.072899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:30.073363 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:30.074112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:30.074568 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:30.075023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:30.208782 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:30.209762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:30.212829 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:30.212998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:30.218779 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:30.219272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:30.219711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:30.220206 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-11f567e8-d83a-4fde-a2e1-5038e3b6da08 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.159160 Aug 10 22:51:30.220424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:30.220780 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 272/551] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:30 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:30.220909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:30.221313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:30.285516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:30.293043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b161af07-abdc-4651-a010-a40ac2274f71 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1269 microversion: 2.1 time: 0.088092 Aug 10 22:51:30.293630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 280/552] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:30 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:31.241137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:31.241702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:31.248237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.248735 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.250751 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.251663 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.252137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.252727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.272459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:31.313946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:31.314561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:31.321477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.321971 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.322415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.323117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.323576 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.324005 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.457064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:31.466386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-40409a6c-2f34-468d-a0e7-042b0cef87db tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1503 microversion: 2.1 time: 0.229164 Aug 10 22:51:31.467255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 273/553] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:31 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:31.487887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b3aaeb3-82f2-40cb-ae2e-55e68b7fbbfd"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:31.490497 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:31.495541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:31.497441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.498116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.498537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.499243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.499692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.500113 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.503485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-36453b4d-3738-41f3-abef-98fb78fde137 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.193469 Aug 10 22:51:31.504059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 281/554] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:31 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:31.524489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] HTTP exception thrown: Cannot 'attach_volume' instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 while it is in vm_state rescued Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Request method failure captured: Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: POST /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447/os-volume_attachments HTTP/1.1 Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 74 Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DYCKYlw68MXeAFmR5fqjvgrUqsL0n9nwTLmQ4I0_7dW16ug4hl5z_6m1p5BJHDmMIW15DDQ9G-MLcnqSWMYvvl4Qjz-oHmnyqlwHJ1qwqOfIHNBN67OnMnYgOErpG0KHmKLwItc1eXMIM1qX6-BSzEwE_1d5cTANt1kIG_sbezjXBY Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:51:31.526541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}] Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 6367371496f04cc2a7c105fbbed68dca Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {"volumeAttachment": {"volumeId": "9b3aaeb3-82f2-40cb-ae2e-55e68b7fbbfd"}} Aug 10 22:51:31.528065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Cannot 'attach_volume' instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 while it is in vm_state rescued Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'server_id': '26ebe63a-b81b-4a3e-8ab3-73ccf0173447', 'body': {'volumeAttachment': {'volumeId': '9b3aaeb3-82f2-40cb-ae2e-55e68b7fbbfd'}}} Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:51:31.528946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 while it is in vm_state rescued Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:51:31.530391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:51:31.531725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:51:31.531725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:51:31.531725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 while it is in vm_state rescued Aug 10 22:51:31.531725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:51:31.531725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Returning 409 to user: Cannot 'attach_volume' instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 while it is in vm_state rescued {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:51:31.531725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c0b08806-8c9e-46bb-9f2a-3d33ac1fb65d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044575 Aug 10 22:51:31.531725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 274/555] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:51:31 2022] POST /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 22:51:31.537453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:31.538046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:31.544347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.544824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.545255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.545962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.546407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.546824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.610466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8a73ca3d-93af-48fd-be36-08646ef15253 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447/action" status: 202 len: 0 microversion: 2.1 time: 0.077003 Aug 10 22:51:31.611105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 282/556] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:51:31 2022] POST /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:51:31.619903 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:31.620515 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:31.626471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.626959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.627402 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.628096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:31.628551 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:31.628979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:31.759770 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:31.767367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bf562f39-ba95-47e0-bd6e-4faecc020d40 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.151866 Aug 10 22:51:31.767933 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 275/557] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:31 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:32.525201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:32.526729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:32.532754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:32.533223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:32.533678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:32.534532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:32.534986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:32.535401 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:32.587501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-1f2c50ca-c2b9-44bb-8d13-916cb10589d2 req-950fc97b-e763-4c88-92bf-daa7b3045a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f0a50ab-30d2-4fab-aa58-fb2fff48956f", "tag": "0f7e4895-9c79-4192-83be-039cf8918024"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:32.608016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-1f2c50ca-c2b9-44bb-8d13-916cb10589d2 req-950fc97b-e763-4c88-92bf-daa7b3045a4c service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:32.608498 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-1f2c50ca-c2b9-44bb-8d13-916cb10589d2 req-950fc97b-e763-4c88-92bf-daa7b3045a4c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:32.608930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-1f2c50ca-c2b9-44bb-8d13-916cb10589d2 req-950fc97b-e763-4c88-92bf-daa7b3045a4c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:32.621773 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-1f2c50ca-c2b9-44bb-8d13-916cb10589d2 req-950fc97b-e763-4c88-92bf-daa7b3045a4c service nova] Creating event network-changed:0f7e4895-9c79-4192-83be-039cf8918024 for instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f on hv-cinder-83608 Aug 10 22:51:32.626804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-1f2c50ca-c2b9-44bb-8d13-916cb10589d2 req-950fc97b-e763-4c88-92bf-daa7b3045a4c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045378 Aug 10 22:51:32.627511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 276/558] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:51:32.696335 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:32.703823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-12a5859f-e4c3-4e90-b400-02a49a37b323 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.183319 Aug 10 22:51:32.704391 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 283/559] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:32 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:32.791112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:32.791851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:32.798067 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:32.798547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:32.798984 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:32.799670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:32.800117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:32.800535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:32.960523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:32.967931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9a1b7ffc-0433-49af-a87b-ac7beaab315d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.181986 Aug 10 22:51:32.968511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 277/560] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:32 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:33.724375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:33.725010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:33.731579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:33.732056 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:33.732486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:33.733165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:33.733635 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:33.734054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:33.866882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:33.874258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9e668e08-d322-417a-9032-78bc9a6686d9 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.153697 Aug 10 22:51:33.874827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 284/561] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:33 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:33.989132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:33.989692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:33.996568 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:33.997045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:33.997514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:33.998194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:33.998639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:33.999054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:34.127568 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:34.135214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bfab3101-d6d7-4f2a-a7bf-62d24de6b931 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.149948 Aug 10 22:51:34.135784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 278/562] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:33 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:34.895216 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:34.895826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:34.903093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:34.903579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:34.904019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:34.904705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:34.905162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:34.905611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:35.032826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:35.040906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-21829d87-cd26-445e-bc78-d25b9a61be08 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.149457 Aug 10 22:51:35.041534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 285/563] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:34 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:35.156037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:35.156577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:35.163160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:35.163647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:35.164112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:35.164805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:35.165259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:35.165972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:35.296134 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:35.304152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-64a78747-d5d4-47ee-a19a-94c0f4c2b5a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.152031 Aug 10 22:51:35.304719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 279/564] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:35 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:36.061537 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:36.062149 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:36.068573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:36.069055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:36.069614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:36.070304 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:36.070756 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:36.071181 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:36.203024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:36.211323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-483dcd22-65e0-4aa4-a4c8-7b7b073b298a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.153648 Aug 10 22:51:36.211936 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 286/565] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:36 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:36.325607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:36.326156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:36.332483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:36.332971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:36.333447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:36.334235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:36.334687 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:36.335117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:36.474056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:36.482481 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1d84091d-e5a0-44cf-8954-8d4d25bacb17 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.160814 Aug 10 22:51:36.483076 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 280/566] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:36 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:37.039976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:37.040730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:37.042720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=4 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:37.043377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=6 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:37.049090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:37.049604 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:37.050047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:37.050753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:37.051214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:37.051643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:37.076371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1e4d3a2a-0415-45fe-852f-e6dad2173fa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/ips" status: 200 len: 151 microversion: 2.20 time: 0.041051 Aug 10 22:51:37.077066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 287/567] 10.222.0.76 () {60 vars in 1289 bytes} [Wed Aug 10 22:51:37 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:51:37.232892 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:37.233552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:37.235946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:37.242445 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:37.242931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:37.243371 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:37.244064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:37.244526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:37.244952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:37.382958 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:37.391263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-470d3af8-a98d-4cf0-b205-282418711d3f tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.162803 Aug 10 22:51:37.391888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 281/568] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:37 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:37.503716 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:37.504424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:37.511686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:37.512170 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:37.512606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:37.513452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:37.513908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:37.514344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:37.645648 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:37.653679 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cebc03b7-466c-4644-b028-8633876c0225 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.153978 Aug 10 22:51:37.654236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 288/569] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:37 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:38.412124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:38.413012 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:38.422411 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:38.422907 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:38.423345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:38.424059 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:38.424511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:38.424932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:38.563897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:38.571519 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a6e9e915-557d-4d67-b15a-8c0f996b8848 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.163297 Aug 10 22:51:38.572155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 282/570] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:38 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:38.675039 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:38.675651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:38.683132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:38.683616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:38.684053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:38.684743 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:38.685197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:38.685648 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:38.825712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:38.836381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1984a5dd-797f-4be6-9334-5c678bcd3ad2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.164839 Aug 10 22:51:38.837244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 289/571] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:38 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:39.592429 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:39.592902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:39.599267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:39.600412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:39.600952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:39.601677 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:39.602121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:39.602540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:39.738093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:39.745951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5252de6f-ff1d-434e-881d-8c6aa62e77dc tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.157549 Aug 10 22:51:39.746519 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 283/572] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:39 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:39.859201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:39.859868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:39.866434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:39.866925 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:39.867370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:39.868106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:39.868563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:39.868991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:39.997553 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:40.005392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0136f019-e2c3-4949-8ea8-28f8dbadaee7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.150058 Aug 10 22:51:40.006607 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 290/573] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:39 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:40.766111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:40.766729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:40.773492 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:40.773993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:40.774439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:40.775148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:40.775623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:40.776041 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:40.912838 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:40.920872 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9d3b4dc5-26cd-43a2-a48c-17858ff7ff64 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.158499 Aug 10 22:51:40.921554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 284/574] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:40 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:41.025840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:41.026352 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:41.032662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.033144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.033611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:41.034303 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.034756 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.035178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:41.066255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:41.067022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:41.073297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.073811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.074249 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:41.074955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.075489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.078269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:41.099238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lazy-loading 'flavor' on Instance uuid 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:51:41.169041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:41.176821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8dd84152-50f0-4de1-9ec5-796d757d5666 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.154925 Aug 10 22:51:41.178195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 291/575] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:41 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:41.277728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9553e6a5-66c3-4d07-931d-414a34bf47ef tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/action" status: 202 len: 0 microversion: 2.20 time: 0.215562 Aug 10 22:51:41.278255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 285/576] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 10 22:51:41 2022] POST /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:51:41.286950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:41.287632 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:41.293805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.294279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.294711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:41.295391 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.295837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.296250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:41.426093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:41.434780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:41.436280 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:41.437459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-643eabd6-7cbf-434a-a24e-106b4020c45c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.154467 Aug 10 22:51:41.438024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 292/577] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:41 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:41.943713 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:41.944460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:41.950687 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.951171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.951606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:41.952302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:41.952757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:41.953185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:42.198746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:42.199361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:42.206445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:42.206975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:42.207373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:42.208085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:42.208544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:42.209819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:42.383355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:42.390859 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:42.391019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-478d2ef6-c1ae-4024-b08b-53b5ce466916 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.452096 Aug 10 22:51:42.391457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 286/578] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:41 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:42.398381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0e8c6cfa-5f65-4669-83cb-c7fc4163d71a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1511 microversion: 2.1 time: 0.203689 Aug 10 22:51:42.399119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 293/579] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:42 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:42.460227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:42.460771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:42.467207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:42.467733 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:42.468145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:42.468844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:42.469321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:42.469779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:42.605943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:42.615074 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:42.616798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:42.618146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7b15f86a-d912-447c-9e72-a7045d5ceb87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.162109 Aug 10 22:51:42.618984 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 287/580] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:42 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:42.956378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1389006556", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1946085716", "security_groups": [{"name": "tempest-secgroup-smoke-322325035"}], "networks": [{"uuid": "9d5c7b2f-301a-45ab-9d32-3731a17cdcc8"}], "block_device_mapping_v2": [{"uuid": "c5936407-d7e5-434c-b197-b2597fee1500", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:43.073532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] validate_networks() for [('9d5c7b2f-301a-45ab-9d32-3731a17cdcc8', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:51:43.413320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:43.413936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:43.422163 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.422709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.423143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.424035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.424648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.425367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.521024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:51:43.521865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:51:43.522451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:51:43.522864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:51:43.523347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:51:43.534803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.535302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.536430 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.537833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.538907 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.542387 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.566662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Getting quotas for project 2df73c10b6654d47a921aa6866d81526. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:51:43.571650 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Getting quotas for user f5fe2bdd1ea54f8cba4d100b26c18464 and project 2df73c10b6654d47a921aa6866d81526. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:51:43.591877 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:43.600332 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d856591d-9e6f-4722-9423-21e14f653648 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.191517 Aug 10 22:51:43.600915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 288/581] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:43 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:43.605450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:43.606131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:43.612176 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.612865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.613528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.614388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.614842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.615266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.620036 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:43.632182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:51:43.634763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5936407-d7e5-434c-b197-b2597fee1500',volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:51:43.758967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:43.767265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-20ba3eb4-0204-4848-8aef-e81a967b73fc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1517 microversion: 2.1 time: 0.165224 Aug 10 22:51:43.768061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 289/582] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:43 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:43.780296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:43.781515 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:43.788884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9036bb66-df15-419b-b543-df1cb9c54361 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.836299 Aug 10 22:51:43.790282 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.790879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.791421 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.792219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:43.792773 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:43.793307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:43.801057 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 294/583] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:51:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:51:43.810954 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b90b5872-de42-458d-9003-f67be2436bc0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:43.814072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b90b5872-de42-458d-9003-f67be2436bc0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:43.931034 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b90b5872-de42-458d-9003-f67be2436bc0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:43.938149 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b90b5872-de42-458d-9003-f67be2436bc0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1089 microversion: 2.1 time: 0.135717 Aug 10 22:51:43.952783 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 295/584] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:43 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1089 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:44.020505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:44.034719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:44.036044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:44.037732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-14ec78d5-2b6c-46bc-b5f1-11a48603a8ca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.262275 Aug 10 22:51:44.038298 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 290/585] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:43 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:44.621074 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:44.621812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:44.628580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:44.629069 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:44.629538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:44.630735 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:44.631242 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:44.631663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:44.760191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:44.767566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cd12fc8b-81d1-47b6-9225-d5fe87c7e204 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.150403 Aug 10 22:51:44.768127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 296/586] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:44 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:44.960017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:44.960566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:44.967261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:44.967749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:44.968185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:44.968880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:44.969356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:44.969784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:45.030030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:45.037763 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4e2e8eb6-a179-4a64-8d30-c1a76f2e598b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1139 microversion: 2.1 time: 0.081978 Aug 10 22:51:45.038331 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 291/587] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:44 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:45.060251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:45.060851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:45.066805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:45.067267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:45.068345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:45.069166 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:45.069643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:45.070065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:45.073889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:45.206899 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:45.215309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:45.216733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:45.217898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ccb245c8-afdf-4c60-b407-c5fe26745597 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.161471 Aug 10 22:51:45.218453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 297/588] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:45 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:45.788910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:45.789554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:45.796101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:45.796598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:45.797032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:45.798048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:45.798712 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:45.799143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:45.867253 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-effd6054-98c2-4ed7-b516-0bfd80cf002a req-630660b3-aa90-413e-bd72-57533c1d9467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f0a50ab-30d2-4fab-aa58-fb2fff48956f", "name": "network-vif-plugged", "status": "completed", "tag": "0f7e4895-9c79-4192-83be-039cf8918024"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:45.878325 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-effd6054-98c2-4ed7-b516-0bfd80cf002a req-630660b3-aa90-413e-bd72-57533c1d9467 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:45.878955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-effd6054-98c2-4ed7-b516-0bfd80cf002a req-630660b3-aa90-413e-bd72-57533c1d9467 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:45.879411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-effd6054-98c2-4ed7-b516-0bfd80cf002a req-630660b3-aa90-413e-bd72-57533c1d9467 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:45.892366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-effd6054-98c2-4ed7-b516-0bfd80cf002a req-630660b3-aa90-413e-bd72-57533c1d9467 service nova] Creating event network-vif-plugged:0f7e4895-9c79-4192-83be-039cf8918024 for instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f on hv-cinder-83608 Aug 10 22:51:45.897994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-effd6054-98c2-4ed7-b516-0bfd80cf002a req-630660b3-aa90-413e-bd72-57533c1d9467 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Aug 10 22:51:45.898688 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 298/589] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:51:45.940660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:45.949564 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4f27d660-9c5e-4927-864d-e4a25af22228 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.165234 Aug 10 22:51:45.950155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 292/590] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:45 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:46.059776 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:46.060620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:46.066791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:46.067278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:46.067798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:46.068601 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:46.069050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:46.069940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:46.135581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:46.143020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0ce9d59a-4a47-436c-87a7-342823691c84 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1131 microversion: 2.1 time: 0.087435 Aug 10 22:51:46.143590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 299/591] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:46 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1131 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:46.240748 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:46.241402 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:46.247786 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:46.248275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:46.248708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:46.249441 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:46.249897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:46.250323 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:46.268178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-910ab0eb-7bb1-441d-9d0e-c08bbe7ce7ca tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'create', calling method: .version_select at 0x7fa9be8c2c10>, body: {"keypair": {"name": "tempest-keypair-1552635695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPYLarXXOxAyTofjJGAo7JXV/kWJpEWRY7ItjSjcxlRDihMTE53WBLrMN1Ug1ljlOgFtVCMyRqh2bXu+VRmXr2hoQeyQjrZd4NOufB5H553+UmUFtScZ1tX2KkX225x3g=="}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:46.283167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-910ab0eb-7bb1-441d-9d0e-c08bbe7ce7ca tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:51:46.287724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-910ab0eb-7bb1-441d-9d0e-c08bbe7ce7ca tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for user 6367371496f04cc2a7c105fbbed68dca and project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:51:46.312464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-910ab0eb-7bb1-441d-9d0e-c08bbe7ce7ca tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047972 Aug 10 22:51:46.319103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 300/592] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:51:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:51:46.412103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:46.420808 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:46.422328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:46.423496 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3ea022d0-2088-4e48-8693-000c585e2c49 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.187507 Aug 10 22:51:46.424058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 293/593] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:46 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:46.970107 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:46.970800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:46.977844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:46.978427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:46.978935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:46.979652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:46.980112 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:46.980572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:47.167612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:47.170854 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:47.186108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:47.187470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:47.188242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:47.189212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:47.189956 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:47.190871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:47.218625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:47.231233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5c46de90-831c-42bf-aa1f-2988c6c0603d tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.265276 Aug 10 22:51:47.232032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 301/594] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:46 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:47.295981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:47.296853 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:47.304241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:47.304950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:47.305573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:47.306464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:47.307053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:47.307625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:47.366959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:47.374549 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f3ec62a3-0535-4d05-873b-e02256859dde tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1187 microversion: 2.1 time: 0.214731 Aug 10 22:51:47.375129 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 294/595] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:47 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1187 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:47.448138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:47.448745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:47.455022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:47.455581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:47.456059 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:47.456762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:47.457222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:47.457674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:47.655466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:47.664549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7d5d7cd9-dc92-4d72-8323-1c03f23b78fe tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1593 microversion: 2.1 time: 0.372838 Aug 10 22:51:47.665541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 302/596] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:47 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1593 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:47.726793 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:47.735310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:47.736896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:47.738177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9d5949c2-8503-4f01-b89c-19c6d3974dca tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.293994 Aug 10 22:51:47.739490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 295/597] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:47 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:51:48.252014 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:48.252632 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:48.259196 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:48.259682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:48.260161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:48.260868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:48.261493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:48.261930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:48.396439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:48.397154 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:48.399594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=74 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:48.406800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:48.407397 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:48.407913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:48.408684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:48.409198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:48.409844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:48.554362 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:48.561836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-763a2c7e-ff93-401d-bf86-e13557dc0671 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1205 microversion: 2.1 time: 0.169667 Aug 10 22:51:48.562411 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 296/598] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:48 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1205 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:48.669476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:48.677554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-471ae7fd-fc4a-49fb-8421-3c4f24958c8e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1317 microversion: 2.1 time: 0.428814 Aug 10 22:51:48.678379 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 303/599] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:48 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:48.762662 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:48.763203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:48.769523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:48.769940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:48.770379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:48.771489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:48.772126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:48.772558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:49.232679 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:49.244866 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:49.246685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:49.248057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-304435da-d1c5-4d30-b185-a67acf964e97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.489753 Aug 10 22:51:49.248640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 297/600] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:48 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:49.267199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-196557829", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04293859-4608-4a33-b65a-9eb0fdac831d"}], "security_groups": [{"name": "tempest-securitygroup--1185994761"}], "key_name": "tempest-keypair-1552635695", "user_data": "}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:49.467532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] validate_networks() for [('04293859-4608-4a33-b65a-9eb0fdac831d', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:51:49.584699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:49.586136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:49.592897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:49.593772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:49.594498 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:49.595818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:49.596636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:49.597234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:49.714157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:49.722450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f13570b9-667d-4183-8d61-060bb91fbd80 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1205 microversion: 2.1 time: 0.142121 Aug 10 22:51:49.723035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 298/601] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:49 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1205 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:49.741916 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:49.742527 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:49.748604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:49.749089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:49.749581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:49.750286 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:49.750742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:49.751167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.194160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:50.201875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-122f1ab8-b805-45a7-989c-521f7ab604b3 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1507 microversion: 2.1 time: 0.464556 Aug 10 22:51:50.202757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 299/602] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:49 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:50.229346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c64e5dc-e036-4303-997d-7c15a338be80", "device": "/dev/sdb"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:50.231780 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:50.237853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.238348 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.238806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.239772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.240237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.240656 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.527420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-05734ff0-0740-4a47-98c5-ecc298dd813a tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "POST /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301932 Aug 10 22:51:50.533272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 300/603] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:51:50 2022] POST /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:51:50.537200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:50.538340 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:50.546894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.547394 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.547829 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.548764 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.549219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.549664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.554264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:51:50.554798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:51:50.555218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:51:50.555870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:51:50.557444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:51:50.575156 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.576023 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.576929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.578343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.579836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.580775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.609808 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:51:50.613750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Getting quotas for user 6367371496f04cc2a7c105fbbed68dca and project 24b951d69396403b9f4b88cea1f3fa76. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:51:50.625434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:51:50.627694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:51:50.675594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-549bff2f-70ad-4739-880c-19592ee0f3e3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.412828 Aug 10 22:51:50.677438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 304/604] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:51:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:51:50.687959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4232a346-963d-44bc-89ca-9c7824083f2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:50.688594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4232a346-963d-44bc-89ca-9c7824083f2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:50.822413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4232a346-963d-44bc-89ca-9c7824083f2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:50.829514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4232a346-963d-44bc-89ca-9c7824083f2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1245 microversion: 2.1 time: 0.145986 Aug 10 22:51:50.843292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 305/605] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:50 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:50.848160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:50.849441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:50.858392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.858877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.859306 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.860210 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:50.860436 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:50.861028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:50.939231 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:50.953459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:50.955448 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:50.959273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-944f519d-cf90-435c-9872-0da2731f0961 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.429581 Aug 10 22:51:50.960203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 301/606] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:50 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:51.182023 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:51.189603 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b6a7b3b5-2f25-41ee-96cd-e8e405a13ae5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.345125 Aug 10 22:51:51.190292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 306/607] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:50 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:51.850543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:51.851427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:51.858824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:51.859322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:51.860064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:51.860469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:51.860940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:51.861551 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:51.954328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:51.965485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-38f8b2af-daa8-43ad-8efb-46e6fe91a8cd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1297 microversion: 2.1 time: 0.119296 Aug 10 22:51:51.983249 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 302/608] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:51 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1297 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:51.983489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:51.983931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:51.990002 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:51.996529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:51.997918 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:52.000187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:52.000187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:52.000187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:52.000892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:52.047863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-13c7b7ae-b355-4c0c-b13b-aff6b757ead3 req-7c475c95-2c97-41c3-8313-88164a2dfc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1c87dd-de83-4565-bada-4f95a28b7f3b", "tag": "14a50685-79f1-4c68-a434-68ccadde1e8f"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:52.060210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-13c7b7ae-b355-4c0c-b13b-aff6b757ead3 req-7c475c95-2c97-41c3-8313-88164a2dfc89 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:52.061066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-13c7b7ae-b355-4c0c-b13b-aff6b757ead3 req-7c475c95-2c97-41c3-8313-88164a2dfc89 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:52.061852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-13c7b7ae-b355-4c0c-b13b-aff6b757ead3 req-7c475c95-2c97-41c3-8313-88164a2dfc89 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:52.075886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-13c7b7ae-b355-4c0c-b13b-aff6b757ead3 req-7c475c95-2c97-41c3-8313-88164a2dfc89 service nova] Creating event network-changed:14a50685-79f1-4c68-a434-68ccadde1e8f for instance de1c87dd-de83-4565-bada-4f95a28b7f3b on hv-cinder-83608 Aug 10 22:51:52.081081 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-13c7b7ae-b355-4c0c-b13b-aff6b757ead3 req-7c475c95-2c97-41c3-8313-88164a2dfc89 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036818 Aug 10 22:51:52.081943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 303/609] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:51:52.213002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:52.214017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:52.220889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:52.221878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:52.222747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:52.224312 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:52.225422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:52.226252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:52.401408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:52.409625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:52.411430 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:52.412875 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-dca803f0-3de2-4ba9-8cb0-5ca57fdb7d7d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.433476 Aug 10 22:51:52.413646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 307/610] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:51 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:51:52.566894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:52.575188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f2049351-4079-4f9e-9e31-987fbc8d43e8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.367605 Aug 10 22:51:52.589970 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 304/611] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:52 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:52.993976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:52.994598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:53.004127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:53.005162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:53.006117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:53.006326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:53.007076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:53.007500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:53.166040 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:53.174441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e8cd612d-30c6-46b9-a86e-951fffb80037 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.186190 Aug 10 22:51:53.175139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 308/612] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:52 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:53.438580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:53.439213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:53.448587 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:53.449094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:53.450273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:53.450663 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:53.451123 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:53.451596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:53.454696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:51:53.599649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:53.600708 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:53.609697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:53.610496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:53.611096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:53.611994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:53.613745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:53.614923 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:53.627105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:53.639065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:53.640556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:53.642032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8fae8663-00e8-411d-b632-8a6535e960e0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.207684 Aug 10 22:51:53.657545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 305/613] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:53 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:53.775334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:53.783688 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e78bfcad-571a-4c2c-9bad-b1e0ae0043a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.191392 Aug 10 22:51:53.797861 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 309/614] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:53 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:54.111702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-6bf66c23-90a9-4919-9a86-ba46f47aebec req-38e3638a-9479-462b-8e5b-09df2901cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76249cfc-607a-42b8-b469-f9ece621ff37", "tag": "474d9c74-6ea7-4b7f-baf3-afc458023ff1"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:54.122372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-6bf66c23-90a9-4919-9a86-ba46f47aebec req-38e3638a-9479-462b-8e5b-09df2901cd92 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.123338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-6bf66c23-90a9-4919-9a86-ba46f47aebec req-38e3638a-9479-462b-8e5b-09df2901cd92 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.123987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-6bf66c23-90a9-4919-9a86-ba46f47aebec req-38e3638a-9479-462b-8e5b-09df2901cd92 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.139162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-6bf66c23-90a9-4919-9a86-ba46f47aebec req-38e3638a-9479-462b-8e5b-09df2901cd92 service nova] Creating event network-changed:474d9c74-6ea7-4b7f-baf3-afc458023ff1 for instance 76249cfc-607a-42b8-b469-f9ece621ff37 on hv-cinder-83608 Aug 10 22:51:54.146094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-6bf66c23-90a9-4919-9a86-ba46f47aebec req-38e3638a-9479-462b-8e5b-09df2901cd92 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037775 Aug 10 22:51:54.147249 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 306/615] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:54.155485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-b344dccc-9d86-4f44-a8ab-078bdb0890bb req-d1e3e7b9-6b38-451d-a5c1-82c8356f472d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d918f389-4e74-4995-91c3-a16be1f17b0b", "tag": "4e93fd28-7dd8-4ea3-93a6-89f48468b295"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:54.166673 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b344dccc-9d86-4f44-a8ab-078bdb0890bb req-d1e3e7b9-6b38-451d-a5c1-82c8356f472d service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.167125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b344dccc-9d86-4f44-a8ab-078bdb0890bb req-d1e3e7b9-6b38-451d-a5c1-82c8356f472d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.167884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b344dccc-9d86-4f44-a8ab-078bdb0890bb req-d1e3e7b9-6b38-451d-a5c1-82c8356f472d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.181000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-b344dccc-9d86-4f44-a8ab-078bdb0890bb req-d1e3e7b9-6b38-451d-a5c1-82c8356f472d service nova] Creating event network-changed:4e93fd28-7dd8-4ea3-93a6-89f48468b295 for instance d918f389-4e74-4995-91c3-a16be1f17b0b on hv-cinder-83608 Aug 10 22:51:54.187304 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-b344dccc-9d86-4f44-a8ab-078bdb0890bb req-d1e3e7b9-6b38-451d-a5c1-82c8356f472d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035676 Aug 10 22:51:54.187912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 310/616] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:54.197496 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:54.198277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:54.206156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.206745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.207529 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.208115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.208750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.209258 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.409703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:54.422337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a1315164-4852-437f-9019-b013e530d39c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.229439 Aug 10 22:51:54.423524 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 307/617] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:54 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:54.575410 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1858859078"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:54.576021 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:54.582203 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.583207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.583639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.584326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.584777 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.585201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.670535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:54.671922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:54.678999 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.679408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.680066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.680863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:54.681411 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:54.682248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:54.811422 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.network.security_group_api [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Adding security group c73afaaa-5432-4dec-bfcf-eb959519445e to port 474d9c74-6ea7-4b7f-baf3-afc458023ff1 Aug 10 22:51:55.007782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:55.023586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:55.025097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:55.026320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-037bf196-6629-4976-85b5-78c1144bf0d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.360063 Aug 10 22:51:55.038108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 308/618] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:54 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:51:55.038108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:55.038108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:55.044152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:55.044863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:55.045558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:55.046491 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:55.047122 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:55.047717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:55.681777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:55.690588 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f3c02ef1-e4c0-453e-afd9-e3a5b5435712 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.662657 Aug 10 22:51:55.692677 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 309/619] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:55 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:55.698929 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:55.700603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:55.713508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:55.714641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:55.715082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:55.716216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:55.716671 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:55.717095 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:55.935314 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-36c1aa92-4d73-4871-98f6-7741cb345e4c tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/action" status: 202 len: 0 microversion: 2.1 time: 1.363710 Aug 10 22:51:55.940918 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 311/620] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:51:54 2022] POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/action => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:51:55.947234 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:55.948101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:55.954920 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:55.956103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:55.956719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:55.958427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:55.959780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:55.960385 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.064910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:56.072393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5dd25e9f-5bdc-4441-a053-cc8e17be2782 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.377659 Aug 10 22:51:56.073367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 310/621] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:55 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:56.077846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:56.078333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:56.089059 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:56.093710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:56.094186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.094976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:56.095395 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:56.095825 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.120439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8cf35df4-eb63-4311-a69c-ecd081acecba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/ips" status: 200 len: 148 microversion: 2.1 time: 0.046198 Aug 10 22:51:56.121511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 311/622] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:51:56 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/ips => generated 148 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:56.126894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:56.127211 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:56.136118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:56.136744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:56.137315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.138122 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:56.138681 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:56.139886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.177344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:56.187316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cefd07a3-106a-42cc-bb2a-2e25b2b52bd9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1758 microversion: 2.1 time: 0.245329 Aug 10 22:51:56.188548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 312/623] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:55 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1758 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:56.193538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-6035ceb1-f42a-4046-9e6a-6d62216e52df req-ba6dd084-98e4-4492-9879-32090ec20fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76249cfc-607a-42b8-b469-f9ece621ff37", "tag": "474d9c74-6ea7-4b7f-baf3-afc458023ff1"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:56.203188 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-6035ceb1-f42a-4046-9e6a-6d62216e52df req-ba6dd084-98e4-4492-9879-32090ec20fe1 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:56.204873 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-6035ceb1-f42a-4046-9e6a-6d62216e52df req-ba6dd084-98e4-4492-9879-32090ec20fe1 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:56.205581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-6035ceb1-f42a-4046-9e6a-6d62216e52df req-ba6dd084-98e4-4492-9879-32090ec20fe1 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.217842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-6035ceb1-f42a-4046-9e6a-6d62216e52df req-ba6dd084-98e4-4492-9879-32090ec20fe1 service nova] Creating event network-changed:474d9c74-6ea7-4b7f-baf3-afc458023ff1 for instance 76249cfc-607a-42b8-b469-f9ece621ff37 on hv-cinder-83608 Aug 10 22:51:56.223030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-6035ceb1-f42a-4046-9e6a-6d62216e52df req-ba6dd084-98e4-4492-9879-32090ec20fe1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032940 Aug 10 22:51:56.223939 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 313/624] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:51:56.304785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:56.313562 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:56.315442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:56.317147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b69453a6-b52b-4231-b4ad-b72c231da6b2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.194544 Aug 10 22:51:56.318416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 312/625] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:56 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:56.712872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:56.713527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:56.719637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:56.720122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:56.720558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.721247 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:56.721723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:56.722147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:56.858850 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:56.866362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9d6134d9-b422-4675-864e-b5eb17f300a7 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.157812 Aug 10 22:51:56.866925 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 314/626] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:56 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:57.093099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:57.093771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:57.101032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:57.101553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:57.101997 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:57.102697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:57.103158 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:57.103588 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:57.234167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:57.242059 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-dfec6617-09c9-4ed1-9f5c-af2d7a790c6c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.152818 Aug 10 22:51:57.242634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 313/627] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:57 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:57.341414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:57.342025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:57.348020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:57.348497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:57.348932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:57.349647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:57.350103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:57.350521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:57.479165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:57.487218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:57.489044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:57.490077 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8d5ca5fb-10a0-4163-989a-b5301eeb48d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.152706 Aug 10 22:51:57.490631 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 315/628] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:57 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:57.886990 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:57.887590 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:57.893678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:57.894166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:57.894623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:57.895322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:57.895771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:57.896189 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:58.033372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:58.042026 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cd9f8cb7-ed84-49d3-87bc-4843ff585a90 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.158888 Aug 10 22:51:58.042606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 314/629] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:57 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:58.263651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:58.264174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:58.270297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:58.270786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:58.271221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:58.271911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:58.272365 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:58.272791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:58.402325 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:58.409586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-31b9b229-d87b-4909-8ae5-5aa478e965b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.150005 Aug 10 22:51:58.410221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 316/630] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:58 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:51:58.515053 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:58.515577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:58.522036 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:58.522520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:58.522952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:58.523636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:58.524084 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:58.524495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:58.593781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "604868ab-03e0-4203-96f8-f5dbcc842d6b"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:51:58.596320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:58.602827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:58.603344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:58.603778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:58.604481 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:58.604932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:58.605374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:58.661844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:58.670353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:58.671871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:58.673018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ecab0009-3c26-49bf-858d-3f2e61f90879 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.162367 Aug 10 22:51:58.673572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 315/631] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:58 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:51:59.062931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:59.063546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:59.070138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:59.070565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:59.071008 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:59.071708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:59.072169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:59.072597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:59.214324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:59.221682 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-db946083-13c2-4c74-b0f9-d4fcac552dc3 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.162604 Aug 10 22:51:59.222246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 316/632] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:59 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:59.431662 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:59.432419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:59.438467 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:59.438943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:59.439382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:59.440105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:59.440555 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:59.440976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:59.579118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:59.587810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-565d1550-e4e0-4df7-b6cc-2aab4bb8a402 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.160698 Aug 10 22:51:59.588374 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 317/633] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:51:59 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:51:59.697796 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:51:59.698310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:51:59.704124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:59.704596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:59.705024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:59.705725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:51:59.706171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:51:59.706593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:51:59.838674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:59.846639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:59.848211 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:51:59.849396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-59ba0081-70b0-407f-bd21-8583d5f3fa69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.155460 Aug 10 22:51:59.849955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 318/634] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:51:59 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:00.243878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:00.244508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:00.250419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:00.250909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:00.251390 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:00.252086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:00.252549 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:00.252977 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:00.389466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:00.397226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f2fb5442-95ac-40c4-8f3e-141df756347a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.157238 Aug 10 22:52:00.397823 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 319/635] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:00 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:00.599048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=4 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:00.607790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:00.608401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:00.614842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:00.615322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:00.615758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:00.616463 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:00.616899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:00.617354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:00.745273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:00.752915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c84a1dde-0c9c-4182-9a2d-ed46811a7fd8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.148893 Aug 10 22:52:00.753765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 320/636] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:00 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:00.826308 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=20 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:00.873609 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:00.874135 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:00.882056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:00.882753 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:00.883194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:00.884255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:00.885030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:00.885505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:01.038890 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:01.047557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:01.049476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:01.051112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-eb96c551-a278-40f5-b6c3-336d732b3736 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.181413 Aug 10 22:52:01.052089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 321/637] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:00 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:01.418373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:01.419186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:01.427255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:01.427898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:01.428503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:01.429880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:01.430376 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:01.430856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:01.582988 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:01.585266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:01.595487 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-07d3ae8a-3280-4f1b-9ed4-c5a4811a1429 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.181392 Aug 10 22:52:01.596419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 322/638] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:01 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:01.776762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:01.777545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:01.783923 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:01.784423 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:01.784932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:01.787728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:01.787728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:01.787728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:01.921639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:01.929089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0d5f667c-aa59-479b-866b-0507122b95ae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.156224 Aug 10 22:52:01.929693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 323/639] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:01 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:02.082603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:02.083428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:02.089454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:02.089939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:02.090382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:02.091078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:02.091539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:02.091971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:02.226684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:02.234678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:02.236208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:02.237393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b7c986fd-3cb5-4112-bc8e-0b7ab30396c2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.159404 Aug 10 22:52:02.238468 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 324/640] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:02 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:02.624571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:02.625179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:02.631350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:02.631835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:02.632271 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:02.632974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:02.633457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:02.633880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:02.834057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:02.841895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f06eae3f-baa1-4e2b-b222-a03331687417 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.221635 Aug 10 22:52:02.855943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 325/641] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:02 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:02.857026 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:02.875952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7cefb727-9774-4be9-980c-73f5e2f431a4 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.285903 Aug 10 22:52:02.876563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 317/642] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:51:58 2022] POST /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments => generated 194 bytes in 4287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:52:02.950696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:02.951308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:02.957791 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:02.958270 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:02.958709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:02.959406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:02.959862 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:02.960288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:03.090744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:03.098119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9653c191-a295-422a-8252-49adc67870c0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.151496 Aug 10 22:52:03.098688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 326/643] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:02 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:03.261418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:03.262117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:03.268719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:03.270264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:03.270627 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:03.271317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:03.271769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:03.272191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:03.438813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:03.438813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:03.446805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:03.447728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:03.448221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:03.449239 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:03.449973 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:03.450670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:03.454801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:03.469397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:03.471040 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:03.473148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e3f98b13-ef2a-4f48-a877-6d12e9673fda tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.215964 Aug 10 22:52:03.474062 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 318/644] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:03 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:03.487266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c99f6106-345d-4632-a1f0-75f5843bf479 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/ips" status: 200 len: 145 microversion: 2.1 time: 0.052609 Aug 10 22:52:03.490161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 327/645] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:52:03 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:03.864843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:03.865516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:03.871986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:03.872469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:03.872901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:03.873620 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:03.874069 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:03.874491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:04.011765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:04.019288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9ab5f7f1-0cb7-407d-9ffa-56bdc533f130 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.159209 Aug 10 22:52:04.020189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 319/646] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:03 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:04.119666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:04.120343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:04.127036 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:04.127606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:04.128050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:04.128825 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:04.129295 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:04.129731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:04.270862 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:04.279401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b854c52d-dbff-4a50-9f93-c2f71f1723de tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.163491 Aug 10 22:52:04.279999 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 328/647] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:04 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:04.503444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:04.504632 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:04.513683 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:04.514592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:04.515688 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:04.516792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:04.518121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:04.520035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:04.571428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-f5b75e5f-8c90-4a95-b347-533b4c1f191f req-48f87da1-26d4-478f-900e-ac215b8d5e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d918f389-4e74-4995-91c3-a16be1f17b0b", "name": "network-vif-plugged", "status": "completed", "tag": "4e93fd28-7dd8-4ea3-93a6-89f48468b295"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:04.591088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-f5b75e5f-8c90-4a95-b347-533b4c1f191f req-48f87da1-26d4-478f-900e-ac215b8d5e6c service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:04.591831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-f5b75e5f-8c90-4a95-b347-533b4c1f191f req-48f87da1-26d4-478f-900e-ac215b8d5e6c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:04.592265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-f5b75e5f-8c90-4a95-b347-533b4c1f191f req-48f87da1-26d4-478f-900e-ac215b8d5e6c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:04.621696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-f5b75e5f-8c90-4a95-b347-533b4c1f191f req-48f87da1-26d4-478f-900e-ac215b8d5e6c service nova] Creating event network-vif-plugged:4e93fd28-7dd8-4ea3-93a6-89f48468b295 for instance d918f389-4e74-4995-91c3-a16be1f17b0b on hv-cinder-83608 Aug 10 22:52:04.630334 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-f5b75e5f-8c90-4a95-b347-533b4c1f191f req-48f87da1-26d4-478f-900e-ac215b8d5e6c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068321 Aug 10 22:52:04.630951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 329/648] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:04.731776 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:04.742436 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:04.744301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:04.745517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-eb1baf5c-9564-47f7-b0e0-3fa8c9c8c80e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.247868 Aug 10 22:52:04.749321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 320/649] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:04 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:05.042083 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:05.042788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:05.049044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:05.049570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:05.050016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:05.051705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:05.052475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:05.052899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:05.190481 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:05.198013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d46c0ff5-fc45-4309-8997-7178c95b952d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.160383 Aug 10 22:52:05.198566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 330/650] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:05 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:05.301791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:05.302428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:05.308404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:05.308886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:05.309341 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:05.310500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:05.311212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:05.311635 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:05.444449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:05.451774 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-db298a88-49e4-4838-8878-cbea80e78b61 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.153931 Aug 10 22:52:05.452335 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 321/651] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:05 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:05.770073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:05.770678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:05.776536 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:05.777004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:05.777481 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:05.778165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:05.778612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:05.779032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:05.911919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:05.919881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:05.921389 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:05.922533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b92c9d2f-94dd-421e-8fbc-1df2744465f3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.157022 Aug 10 22:52:05.923094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 331/652] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:05 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:06.218744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:06.219346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:06.226255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:06.226733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:06.227168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:06.227847 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:06.228294 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:06.228717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:06.359950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:06.368412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-eb9c36f8-ff1f-4f6f-b275-96884b299770 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.153433 Aug 10 22:52:06.368988 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 322/653] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:06 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:06.473188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:06.473818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:06.480290 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:06.480771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:06.481200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:06.481917 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:06.482365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:06.482785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:06.614911 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:06.622368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-52e3fe71-7570-4ada-aeb1-78eaa8128ddf tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.153516 Aug 10 22:52:06.622936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 332/654] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:06 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:06.946518 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:06.947229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:06.953192 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:06.953715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:06.954152 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:06.954842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:06.955299 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:06.955727 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:07.090446 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:07.098443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:07.099935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:07.101086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fe44c1c0-4887-4303-9d00-792801b55210 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.158800 Aug 10 22:52:07.101681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 323/655] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:06 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:07.388632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:07.389254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:07.395422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:07.395899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:07.396329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:07.397008 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:07.397493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:07.397913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:07.529677 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:07.537121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-267ff72b-bd9c-46b1-9dcb-01757fd62e59 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.152314 Aug 10 22:52:07.537726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 333/656] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:07 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:07.642554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:07.643089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:07.649683 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:07.650169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:07.650608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:07.651299 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:07.651757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:07.652213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:07.786187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:07.801974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-da0545e5-354d-4238-bf5e-7053f7a96ff5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.162651 Aug 10 22:52:07.803161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 324/657] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:07 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:08.124427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:08.124942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:08.130983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:08.131460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:08.131889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:08.132573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:08.133019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:08.133465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:08.264176 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:08.272640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:08.274164 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:08.275349 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e3443d78-28f1-4363-b376-eb7bb8851769 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.155057 Aug 10 22:52:08.275898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 334/658] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:08 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:08.558327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:08.558933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:08.564831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:08.565333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:08.566391 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:08.567228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:08.567682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:08.568103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:08.699509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:08.707750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c327b7c3-68a6-4627-9055-0f29a0691870 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.153148 Aug 10 22:52:08.708317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 325/659] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:08 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:08.824476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:08.824476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:08.829790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:08.830276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:08.830709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:08.832262 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:08.832720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:08.833501 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:08.963276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:08.970643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1bfb96fb-ac56-4fec-959d-888f58e261a3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.151616 Aug 10 22:52:08.971202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 335/660] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:08 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:09.299433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:09.300893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:09.307653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:09.308180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:09.308651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:09.309372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:09.309828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:09.310252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:09.441232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:09.449138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:09.450727 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:09.451922 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fabb6710-4356-46b1-b399-ece41e4eddb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.156403 Aug 10 22:52:09.452493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 326/661] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:09 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:09.728611 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:09.729227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:09.735237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:09.735724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:09.736167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:09.736861 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:09.737348 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:09.737790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:09.889891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:09.898328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-573f0721-c5ee-40de-b0d3-bc857db508f5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.173544 Aug 10 22:52:09.898891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 336/662] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:09 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:09.990578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:09.991098 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:09.997501 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:09.997984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:09.998421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:09.999418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:09.999873 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:10.000297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:10.131527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:10.138748 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-21145593-1de8-4d2e-958b-0b5ee6a7f1b5 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.152209 Aug 10 22:52:10.139340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 327/663] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:09 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:10.483473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:10.484116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:10.491179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:10.491675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:10.492115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:10.492823 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:10.493367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:10.494159 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:10.634043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:10.642038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:10.643717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:10.645141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-482a97c9-cf88-4f3a-b72d-f89da9966345 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.165592 Aug 10 22:52:10.645733 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 337/664] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:10 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:10.919537 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:10.920261 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:10.927826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:10.928384 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:10.928826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:10.929548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:10.930004 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:10.930427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:11.059933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:11.067337 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a17b0786-1cd9-450c-b558-89ecab961f91 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.151646 Aug 10 22:52:11.067898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 328/665] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:10 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:11.166343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:11.166871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:11.173292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:11.173786 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:11.174224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:11.175166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:11.175840 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:11.176309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:11.315478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:11.322922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c4db9e6a-e33c-4d20-acbe-75f1db2ea1a6 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.160842 Aug 10 22:52:11.323503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 338/666] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:11 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:11.668959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:11.670057 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:11.676904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:11.677419 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:11.678144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:11.678848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:11.679386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:11.679986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:11.812872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:11.821191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:11.822726 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:11.823873 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-69764531-2090-41ea-9e69-3d061c5b9262 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.159299 Aug 10 22:52:11.824426 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 329/667] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:11 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:12.088271 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:12.088896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:12.094981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.095487 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.095927 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.097419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.097895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.098333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.234154 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:12.241983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2f1e9bf3-0047-4363-990b-39aa82599b64 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.157655 Aug 10 22:52:12.242587 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 339/668] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:12 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:12.344049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:12.345420 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:12.358103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5a1a5fb-1553-4c31-9018-753e4da44879"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:12.359108 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.359655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.360036 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.360873 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.361549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.361919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.367965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:12.374511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.375177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.375789 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.376726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.377382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.378002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.394892 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:12.527044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:12.535047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f9d9ca9b-daab-43b9-81e8-322315c6a622 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.194916 Aug 10 22:52:12.535619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 330/669] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:12 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:12.540206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-71cf9bf7-d451-45e4-9310-ad43f3d266d5 req-ca9d23f7-1ddd-4365-aa2f-b88202e621e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1c87dd-de83-4565-bada-4f95a28b7f3b", "name": "network-vif-plugged", "status": "completed", "tag": "14a50685-79f1-4c68-a434-68ccadde1e8f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:12.549334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-71cf9bf7-d451-45e4-9310-ad43f3d266d5 req-ca9d23f7-1ddd-4365-aa2f-b88202e621e0 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.550451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-71cf9bf7-d451-45e4-9310-ad43f3d266d5 req-ca9d23f7-1ddd-4365-aa2f-b88202e621e0 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.550880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-71cf9bf7-d451-45e4-9310-ad43f3d266d5 req-ca9d23f7-1ddd-4365-aa2f-b88202e621e0 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.561405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-71cf9bf7-d451-45e4-9310-ad43f3d266d5 req-ca9d23f7-1ddd-4365-aa2f-b88202e621e0 service nova] Creating event network-vif-plugged:14a50685-79f1-4c68-a434-68ccadde1e8f for instance de1c87dd-de83-4565-bada-4f95a28b7f3b on hv-cinder-83608 Aug 10 22:52:12.566315 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-71cf9bf7-d451-45e4-9310-ad43f3d266d5 req-ca9d23f7-1ddd-4365-aa2f-b88202e621e0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029608 Aug 10 22:52:12.566891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 331/670] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:12.848080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:12.848765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:12.855949 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.856461 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.856896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.857608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:12.858056 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:12.858473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:12.989483 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:12.997297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:12.998815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:12.999976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-88dd9bfd-6bfa-4c7c-8825-349db28c6aa9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.156157 Aug 10 22:52:13.000542 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 332/671] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:12 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:13.262028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:13.262627 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:13.269491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:13.270005 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:13.270437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:13.271121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:13.271569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:13.272015 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:13.406440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:13.414230 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e6f55c69-1df8-4c3f-ac5e-119ffed5af23 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.156092 Aug 10 22:52:13.414796 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 333/672] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:13 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:13.556416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:13.557027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:13.562897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:13.563377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:13.563814 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:13.564499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:13.565653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:13.566223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:13.696332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:13.700838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:13.705749 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7b189f2a-c960-4b7a-8d2b-1960afc6640e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.152864 Aug 10 22:52:13.706326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 334/673] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:13 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:14.024692 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:14.025207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:14.031416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:14.031893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:14.032324 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:14.033003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:14.033482 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:14.034536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:14.165191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:14.172956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:14.174492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:14.175641 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-20290d1a-b1bf-49b0-ad28-d2d396c025d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.155599 Aug 10 22:52:14.176198 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 335/674] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:14 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:14.435144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:14.435750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:14.442797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:14.443279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:14.443705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:14.444381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:14.444826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:14.445239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:14.581305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:14.588660 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1d45d38d-0168-42ef-a58e-ade900411f88 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.157331 Aug 10 22:52:14.589230 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 336/675] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:14 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:14.726472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:14.727124 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:14.732979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:14.733497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:14.733930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:14.734614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:14.735063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:14.735498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:14.871616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:14.879560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c97568d1-4244-4b01-87ad-766cab6ca8d4 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.156983 Aug 10 22:52:14.880119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 337/676] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:14 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:15.199863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:15.200463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:15.207349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:15.207828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:15.208265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:15.208950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:15.209434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:15.209863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:15.341921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:15.349720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:15.351217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:15.352356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6fcb1600-a65a-461d-a1f5-063d964158df tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.156450 Aug 10 22:52:15.352917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 338/677] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:15 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:15.609989 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:15.610637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:15.617763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:15.618250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:15.618689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:15.619390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:15.619847 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:15.620274 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:15.757639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:15.765019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8450ccc1-0255-4ede-bb16-7402c9f9dbea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.159107 Aug 10 22:52:15.765621 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 339/678] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:15 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:15.899986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:15.900592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:15.906484 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:15.906966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:15.907399 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:15.908083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:15.909136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:15.909747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:16.040408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:16.047981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7b410633-03f5-4904-b668-23f816c5b79d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.151840 Aug 10 22:52:16.048548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 340/679] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:15 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:16.375313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:16.375913 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:16.382737 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:16.383224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:16.383661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:16.384366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:16.384819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:16.385255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:16.523336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:16.531297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:16.532781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:16.533982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cc1a6cc7-968e-44cb-b3c3-a82598582c62 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.162561 Aug 10 22:52:16.534538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 341/680] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:16 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:16.785798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:16.786442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:16.793051 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:16.793572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:16.794015 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:16.794702 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:16.795155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:16.795575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:16.927649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:16.935116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-665708a5-2dbe-4e77-a7d9-55c1b843a86c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.153320 Aug 10 22:52:16.935678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 342/681] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:16 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:17.069865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:17.070486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:17.076394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:17.076878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:17.077342 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:17.078034 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:17.078489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:17.078915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:17.211237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:17.219016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-651274b6-a5de-46c6-8bc6-920d8f2792f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.154501 Aug 10 22:52:17.219803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 343/682] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:17 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:17.556498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:17.557007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:17.562916 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:17.563393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:17.563824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:17.564558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:17.565167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:17.565736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:17.691927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:17.699996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:17.701520 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:17.702664 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bbc8a4e2-0606-4dfe-b10e-76a1191ef4f6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.150197 Aug 10 22:52:17.703252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 344/683] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:17 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:17.956744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:17.957435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:17.963646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:17.964119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:17.964547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:17.965230 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:17.965727 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:17.966118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:18.104462 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:18.112273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f8d0fe6b-1d7a-4aca-976b-cb60affe0a74 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.159791 Aug 10 22:52:18.112863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 345/684] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:17 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:18.240095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:18.240630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:18.246701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:18.247195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:18.247633 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:18.248347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:18.248785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:18.249175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:18.381902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:18.389607 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2959e3ce-37d2-45a0-b9c8-a13f678de8fa tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.153466 Aug 10 22:52:18.390176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 346/685] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:18 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:18.726795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:18.727404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:18.733479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:18.733967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:18.734407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:18.735104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:18.735564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:18.735987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:18.866025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:18.873881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:18.875363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:18.876496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-33b2c710-fcd4-41c0-b387-7d692079ee40 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.153886 Aug 10 22:52:18.877052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 347/686] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:18 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:19.133195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:19.134011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:19.140233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:19.140717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:19.141152 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:19.141863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:19.142320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:19.143394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:19.276233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:19.285691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0f72fc1e-b83e-4531-a681-a621c2cd755b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.156202 Aug 10 22:52:19.286275 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 348/687] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:19 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:19.410317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:19.410845 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:19.417024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:19.417543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:19.417983 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:19.418654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:19.419106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:19.419525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:19.553875 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:19.561505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cdcf533d-5eee-42e4-9611-fbe4d3e1e413 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1371 microversion: 2.1 time: 0.155062 Aug 10 22:52:19.562098 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 349/688] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:19 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:19.899472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:19.900151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:19.906332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:19.906825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:19.907266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:19.907962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:19.909102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:19.909558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:20.060413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:20.068614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:20.070150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:20.071309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-290703f8-9020-40ad-8a77-812acf3ad71c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.175674 Aug 10 22:52:20.071868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 350/689] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:19 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:20.307042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:20.307711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:20.313927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:20.315008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:20.315455 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:20.316140 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:20.316591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:20.317015 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:20.335198 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:20.453174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:20.462072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0ec18aed-7b10-4f4e-8a61-d2ed81e6c683 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.158866 Aug 10 22:52:20.462653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 351/690] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:20 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:20.584078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:20.584603 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:20.590508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:20.590993 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:20.591430 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:20.592119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:20.592576 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:20.593003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:20.730298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:20.739137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-168d519c-e705-4f96-bb5e-0807b33720df tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1566 microversion: 2.1 time: 0.158826 Aug 10 22:52:20.740134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 352/691] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:20 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:20.754156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-23c08a45-f706-4c33-95dd-cd44be0abfd9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.399795 Aug 10 22:52:20.754822 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 340/692] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:52:12 2022] POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-volume_attachments => generated 194 bytes in 8401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:20.763248 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:20.763746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:20.770501 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:20.772547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:20.773001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:20.773767 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:20.774231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:20.774863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:20.857124 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f74ee195-59fe-46be-a3e0-1784519d4c4c tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098401 Aug 10 22:52:20.857765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 353/693] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:52:20 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:21.098029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:21.098763 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:21.101214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=90 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:21.107968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:21.108382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:21.108816 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:21.109548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:21.110004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:21.110426 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:21.482920 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:21.483632 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:21.490836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:21.491145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:21.491586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:21.492283 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:21.492737 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:21.493156 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:21.675068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:21.683490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:21.685171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:21.686458 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-530bbd21-e201-4367-a97b-687a9f0a004d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.594887 Aug 10 22:52:21.687015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 341/694] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:21 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:21.762574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:21.772004 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-99e09ce2-2973-4410-b3ea-26d275688d82 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.293633 Aug 10 22:52:21.772586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 354/695] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:21 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:22.070433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-05c08531-16d0-4875-af9f-70442e20f646 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: .version_select at 0x7fa9be6a8940>, body: {"keypair": {"name": "tempest-keypair-1637457234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCwwG7w2BCcbUDnu800km/iWeQ6blvBMWuT7kjjAYRqJnw3cH7RsjLkktaxgGC7hGT5GZby2Mhxst3ea8tL11IFOuTuE1vdXizjkZBvRRNC6U7/bDGVwbXndyZjFMha/g=="}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:22.087538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-05c08531-16d0-4875-af9f-70442e20f646 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:52:22.091842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-05c08531-16d0-4875-af9f-70442e20f646 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:52:22.115041 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-05c08531-16d0-4875-af9f-70442e20f646 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048527 Aug 10 22:52:22.115647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 342/696] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:52:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:22.312823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-99ab2b85-4e6c-482b-bf96-3de6efb52e7b req-fc537ce1-b8ca-4d8c-9984-8a0216700414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d918f389-4e74-4995-91c3-a16be1f17b0b", "tag": "4e93fd28-7dd8-4ea3-93a6-89f48468b295"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:22.318517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=96 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:22.326152 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-99ab2b85-4e6c-482b-bf96-3de6efb52e7b req-fc537ce1-b8ca-4d8c-9984-8a0216700414 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:22.328055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-99ab2b85-4e6c-482b-bf96-3de6efb52e7b req-fc537ce1-b8ca-4d8c-9984-8a0216700414 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:22.328512 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-99ab2b85-4e6c-482b-bf96-3de6efb52e7b req-fc537ce1-b8ca-4d8c-9984-8a0216700414 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:22.343550 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-99ab2b85-4e6c-482b-bf96-3de6efb52e7b req-fc537ce1-b8ca-4d8c-9984-8a0216700414 service nova] Creating event network-changed:4e93fd28-7dd8-4ea3-93a6-89f48468b295 for instance d918f389-4e74-4995-91c3-a16be1f17b0b on hv-cinder-83608 Aug 10 22:52:22.349805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-99ab2b85-4e6c-482b-bf96-3de6efb52e7b req-fc537ce1-b8ca-4d8c-9984-8a0216700414 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041635 Aug 10 22:52:22.350730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 355/697] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:22.630869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:22.631362 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:22.638149 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:22.638851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:22.639289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:22.640057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:22.640506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:22.641107 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:22.722356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:22.726161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:22.741081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:22.744088 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:22.744797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:22.746218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:22.747209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:22.747875 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:22.882304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lazy-loading 'services' on Instance uuid 5f0a50ab-30d2-4fab-aa58-fb2fff48956f {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:52:22.932636 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:22.942121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:22.957194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:22.960333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-78934c18-1c50-471c-98c7-b846d8194455 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.251037 Aug 10 22:52:22.960929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 356/698] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:22 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:22.979240 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:22.980295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:22.987114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:22.987754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:22.988199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:22.988907 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:22.989391 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:22.989821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:23.019503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-623d849d-365e-4d33-a5d8-7a61554ac3eb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f/os-volume_attachments/0c64e5dc-e036-4303-997d-7c15a338be80" status: 202 len: 0 microversion: 2.1 time: 0.391786 Aug 10 22:52:23.023769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 343/699] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:52:22 2022] DELETE /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f/os-volume_attachments/0c64e5dc-e036-4303-997d-7c15a338be80 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:52:23.157145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:23.167237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f90d3586-0ab2-4dea-b957-5bf46db40a0c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.205233 Aug 10 22:52:23.167816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 357/700] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:22 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:23.612963 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1027491246", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67b001b8-3d70-41ad-865c-43e8ac074765"}], "security_groups": [{"name": "tempest-securitygroup--987455179"}], "key_name": "tempest-keypair-1637457234", "user_data": "}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:23.758272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] validate_networks() for [('67b001b8-3d70-41ad-865c-43e8ac074765', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:52:23.983344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:23.983961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:23.990486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:23.990977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:23.991418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:23.992123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:23.992581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:23.993005 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:24.207364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:24.215498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:24.217087 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:24.218360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f3202036-919b-4a16-b77f-eb0b8ad31a74 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.238938 Aug 10 22:52:24.218994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 358/701] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:23 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:24.229703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:24.230721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:24.236843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:24.237434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:24.237910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:24.238616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:24.239071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:24.239491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:24.246699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:52:24.247118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:52:24.247591 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:52:24.247996 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:52:24.248403 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:52:24.261612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:24.263598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:24.265887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:24.266672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:24.267857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:24.268295 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:24.288680 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:52:24.293188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:52:24.306382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:52:24.308790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:52:24.368044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-132fe673-9241-4bf2-b1f1-71a8d1b02a4d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.760134 Aug 10 22:52:24.369151 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 344/702] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:52:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:52:24.381198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5564b30b-a21f-4c69-876f-e6a62303cd21 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:24.382108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5564b30b-a21f-4c69-876f-e6a62303cd21 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:24.398752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:24.407509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-82b518b4-d836-493a-9799-75b29b2333f1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1260 microversion: 2.1 time: 0.181591 Aug 10 22:52:24.409270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 359/703] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:24 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:24.464391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5564b30b-a21f-4c69-876f-e6a62303cd21 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:24.471565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5564b30b-a21f-4c69-876f-e6a62303cd21 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1242 microversion: 2.1 time: 0.095456 Aug 10 22:52:24.472470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 345/704] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:24 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:24.642813 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-d136f351-a6e6-4332-aacf-7d9c1fbe5180 req-eeefa9ee-5c19-48e8-8f6a-4e9e98ad9dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0", "name": "network-vif-plugged", "status": "completed", "tag": "1090c7bb-79eb-4915-b7e9-12cdfafe465a"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:24.671214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d136f351-a6e6-4332-aacf-7d9c1fbe5180 req-eeefa9ee-5c19-48e8-8f6a-4e9e98ad9dda service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:24.671758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d136f351-a6e6-4332-aacf-7d9c1fbe5180 req-eeefa9ee-5c19-48e8-8f6a-4e9e98ad9dda service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:24.672213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d136f351-a6e6-4332-aacf-7d9c1fbe5180 req-eeefa9ee-5c19-48e8-8f6a-4e9e98ad9dda service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:24.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-d136f351-a6e6-4332-aacf-7d9c1fbe5180 req-eeefa9ee-5c19-48e8-8f6a-4e9e98ad9dda service nova] Creating event network-vif-plugged:1090c7bb-79eb-4915-b7e9-12cdfafe465a for instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 on hv-cinder-83608 Aug 10 22:52:24.690770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-d136f351-a6e6-4332-aacf-7d9c1fbe5180 req-eeefa9ee-5c19-48e8-8f6a-4e9e98ad9dda service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054130 Aug 10 22:52:24.691906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 360/705] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:25.242113 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:25.242721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:25.250105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.250586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.251023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:25.252370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.252912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.253379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:25.392319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:25.400141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:25.401658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:25.402800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2580661e-d564-417e-bd64-a512b5301300 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.164677 Aug 10 22:52:25.403358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 346/706] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:25 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:25.431164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:25.431851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:25.437990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.438475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.438930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:25.439682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.440050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.440465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:25.493393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:25.494143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:25.500886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.502011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.502464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:25.503178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.503636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.504065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:25.599060 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:25.610286 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-47b9039c-ddcd-49f9-bda8-c8dc6f3c748a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1294 microversion: 2.1 time: 0.120196 Aug 10 22:52:25.626210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 347/707] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:25 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:25.754188 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:25.763592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-83ca6a8a-d9b8-4482-bbd4-ebd1866fea3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1444 microversion: 2.1 time: 0.337157 Aug 10 22:52:25.773243 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 361/708] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:25 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1444 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:25.785999 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:25.786914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:25.795168 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.795655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.796091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:25.796911 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:25.797462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:25.797885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:26.012495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:26.020345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cf2676a4-8387-4bc7-8a25-bda009109395 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1444 microversion: 2.1 time: 0.239002 Aug 10 22:52:26.020994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 348/709] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:25 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1444 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:26.426865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:26.427478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:26.434773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:26.435292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:26.435683 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:26.436456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:26.436936 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:26.437396 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:26.636311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:26.636967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:26.644827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:26.645376 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:26.645818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:26.646534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:26.646994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:26.647575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:26.790846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:26.798827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4a784e0c-b74d-408c-9ea4-5e8caf2b5039 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1300 microversion: 2.1 time: 0.168756 Aug 10 22:52:26.799590 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 349/710] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:26 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:26.854701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:26.862624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:26.864147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:26.865311 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-64d7c67a-dc3d-435e-9717-0bb9d85d0a2c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.443256 Aug 10 22:52:26.877552 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 362/711] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:26 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:27.819700 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:27.820292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:27.826593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:27.827077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:27.827511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:27.828199 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:27.828683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:27.829951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:27.889476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:27.890093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:27.897648 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:27.898142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:27.898584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:27.899288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:27.899742 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:27.900167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:28.190619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:28.198550 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2e3e0275-401b-482f-9450-183e8d50367c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.382766 Aug 10 22:52:28.199232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 350/712] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:27 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:28.278705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:28.287284 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:28.288793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:28.290007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f703a555-10fa-48c2-8aed-cc1bd6d3b051 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.404431 Aug 10 22:52:28.290559 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 363/713] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:27 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:28.579949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-bc2e7528-18e5-4714-b571-4d9960c91486 req-2a976997-051a-485a-9d2f-fb1c486e807d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5", "tag": "708f09d8-ca6d-45f9-a30a-a8c44395f181"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:28.589799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-bc2e7528-18e5-4714-b571-4d9960c91486 req-2a976997-051a-485a-9d2f-fb1c486e807d service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:28.590286 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-bc2e7528-18e5-4714-b571-4d9960c91486 req-2a976997-051a-485a-9d2f-fb1c486e807d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:28.590774 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-bc2e7528-18e5-4714-b571-4d9960c91486 req-2a976997-051a-485a-9d2f-fb1c486e807d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:28.602179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-bc2e7528-18e5-4714-b571-4d9960c91486 req-2a976997-051a-485a-9d2f-fb1c486e807d service nova] Creating event network-changed:708f09d8-ca6d-45f9-a30a-a8c44395f181 for instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 on hv-cinder-83608 Aug 10 22:52:28.607075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-bc2e7528-18e5-4714-b571-4d9960c91486 req-2a976997-051a-485a-9d2f-fb1c486e807d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030988 Aug 10 22:52:28.607982 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 351/714] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:29.219285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:29.221622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:29.228188 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:29.228675 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:29.229112 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:29.229860 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:29.230485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:29.230916 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:29.318575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:29.319950 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:29.327311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:29.328123 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:29.328778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:29.330645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:29.331497 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:29.339049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:29.435671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:29.446651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-95ccd66c-c1b0-4c1e-a280-84bc36468f9a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.231061 Aug 10 22:52:29.461596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 364/715] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:29 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:29.475418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-98c9fdbc-c7e2-4a03-abfa-795c06cb5785 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:29.485932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98c9fdbc-c7e2-4a03-abfa-795c06cb5785 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:29.486642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98c9fdbc-c7e2-4a03-abfa-795c06cb5785 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:29.487255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-98c9fdbc-c7e2-4a03-abfa-795c06cb5785 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:29.522317 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:29.541896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:29.545782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:29.547017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-466888f5-637d-47a9-8bac-1575c308ba88 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1741 microversion: 2.20 time: 0.235109 Aug 10 22:52:29.547582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 352/716] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:29 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:29.556236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-98c9fdbc-c7e2-4a03-abfa-795c06cb5785 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Going to try to stop instance {{(pid=132540) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 22:52:29.601572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-98c9fdbc-c7e2-4a03-abfa-795c06cb5785 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action" status: 202 len: 0 microversion: 2.1 time: 0.136712 Aug 10 22:52:29.605219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 365/717] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:52:29 2022] POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:52:29.611014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:29.611620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:29.617534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:29.618015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:29.618447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:29.619132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:29.619578 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:29.619995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:29.765238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:29.773447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-03c9b116-404c-48b1-9b12-374f04ee332e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.166633 Aug 10 22:52:29.774253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 353/718] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:29 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:30.468536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:30.469472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:30.478327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:30.479014 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:30.479558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:30.480369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:30.481083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:30.481747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:30.570751 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:30.571267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:30.579387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:30.580147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:30.580626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:30.582001 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:30.582395 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:30.590066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:30.788703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:30.797879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5cf43add-1d23-4d2c-9456-f168b0525aa7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.333396 Aug 10 22:52:30.801375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 366/719] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:30 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:30.804272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-1bc86728-634c-413d-bcda-eaed346730b5 req-1986be0b-bbb4-4f3d-badb-41c7fae59da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1c87dd-de83-4565-bada-4f95a28b7f3b", "tag": "14a50685-79f1-4c68-a434-68ccadde1e8f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:30.814967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1bc86728-634c-413d-bcda-eaed346730b5 req-1986be0b-bbb4-4f3d-badb-41c7fae59da6 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:30.815844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1bc86728-634c-413d-bcda-eaed346730b5 req-1986be0b-bbb4-4f3d-badb-41c7fae59da6 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:30.816456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-1bc86728-634c-413d-bcda-eaed346730b5 req-1986be0b-bbb4-4f3d-badb-41c7fae59da6 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:30.839091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-1bc86728-634c-413d-bcda-eaed346730b5 req-1986be0b-bbb4-4f3d-badb-41c7fae59da6 service nova] Creating event network-changed:14a50685-79f1-4c68-a434-68ccadde1e8f for instance de1c87dd-de83-4565-bada-4f95a28b7f3b on hv-cinder-83608 Aug 10 22:52:30.847510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-1bc86728-634c-413d-bcda-eaed346730b5 req-1986be0b-bbb4-4f3d-badb-41c7fae59da6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047104 Aug 10 22:52:30.848573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 367/720] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:30.855947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:30.856945 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:30.866637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:30.867533 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:30.869947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:30.870987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:30.871837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:30.874227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:31.207155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:31.231928 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:31.235029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:31.238434 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a90195e5-f236-4021-89dd-01189bb62be4 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.671723 Aug 10 22:52:31.239846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 354/721] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:30 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:31.345670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:31.355670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d352bdea-0ec0-4b3e-b8c9-a828d0192fe7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.505576 Aug 10 22:52:31.356506 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 368/722] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:30 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:31.636497 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:31.637252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:31.644868 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:31.645390 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:31.645833 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:31.646546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:31.647007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:31.647436 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:31.679316 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:52:31.781114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-55488fe5-120f-4ded-b91d-ad1aa11ffce0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 204 len: 0 microversion: 2.1 time: 0.150308 Aug 10 22:52:31.781738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 355/723] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:52:31 2022] DELETE /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:52:31.792023 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:31.792729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:31.800962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:31.801570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:31.802083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:31.802869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:31.803477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:31.804880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:31.822383 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:31.823395 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:31.828534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:31.831306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:31.832241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:31.833090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:31.834057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:31.834723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:31.835692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:32.058626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:32.073167 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-44af2bdb-e336-4efc-92e1-c75dcd3d9afb tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1513 microversion: 2.1 time: 0.286124 Aug 10 22:52:32.074133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 369/724] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:31 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:32.077559 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:32.085296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:32.087581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4e9bd15b-6fa6-4369-9386-60372b5bfa59 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.270186 Aug 10 22:52:32.088640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 356/725] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:31 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:32.268452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:32.269353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:32.292046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:32.292046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:32.292046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:32.292705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:32.293239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:32.293762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:32.380135 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:32.380948 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:32.392747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:32.393311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:32.393743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:32.394450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:32.394902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:32.395321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:32.492466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:32.500562 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:32.502321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:32.503480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f72b729c-f281-43c8-a7f0-bdc81ae5101b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.240441 Aug 10 22:52:32.504407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 370/726] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:32 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:32.573081 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:32.582236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7974d366-18e5-4890-852f-e3c0ca392e65 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.208447 Aug 10 22:52:32.583217 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 357/727] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:32 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:33.097467 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:33.098800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:33.109908 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:33.110808 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:33.116917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.117447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.117891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.118602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.119055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.119476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.127274 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.127784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.128402 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.129244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.129791 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.130169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.362719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:33.371059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-77d52ef8-752d-4340-b0bd-caff53b0e01e tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1513 microversion: 2.1 time: 0.277704 Aug 10 22:52:33.372036 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 371/728] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:33 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:33.399976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:33.408384 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fc9068ea-f466-41cf-bb15-a63b79d4d39a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.302593 Aug 10 22:52:33.413397 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 358/729] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:33 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:33.604438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:33.605060 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:33.612068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.612573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.613027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.614191 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.614766 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.615075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.661160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:33.661822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:33.668085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.668768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.669220 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.670151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:33.670610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:33.671039 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:33.867146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:33.873829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:33.877102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e4792424-7491-4e44-947f-7fb4ab9d858c tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.276859 Aug 10 22:52:33.878038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 359/730] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:33 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:33.883533 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:33.885211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:33.886477 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ead819ff-a7e8-4af7-88ae-bbd58ba94b81 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.363293 Aug 10 22:52:33.887117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 372/731] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:33 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:34.396711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:34.397677 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:34.400152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:34.405993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.406526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.407126 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:34.407741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.408201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.408623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:34.432251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:34.433918 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:34.440921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.441458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.441905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:34.442624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.443090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.443517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:34.468351 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=12 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:34.631583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:34.646844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-161fd7fb-20ab-48ad-94b0-e90139524ce1 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1513 microversion: 2.1 time: 0.253722 Aug 10 22:52:34.647810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 360/732] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:34 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:34.683037 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:34.691444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-253e323b-18ae-4124-83f2-088e7b0caaad tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.266193 Aug 10 22:52:34.705303 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 373/733] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:34 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:34.903121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:34.903645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:34.910952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:34.911616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:34.912152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.912922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.913394 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:34.915510 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.918400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.919447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:34.925453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.925453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.925733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:34.926395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:34.926851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:34.927309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:35.142781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:35.151114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:35.152622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:35.153917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d051537a-4714-4267-a97c-e54352d9616e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.247677 Aug 10 22:52:35.169843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 374/734] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:34 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:35.191996 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:35.200785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1c2dd029-1d80-46f4-8b5a-1174f96325e2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.302280 Aug 10 22:52:35.201627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 361/735] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:34 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:35.667634 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:35.668288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:35.675759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:35.676363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:35.676799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:35.677546 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:35.678005 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:35.678434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:35.713237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:35.714413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:35.721381 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:35.721718 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:35.722225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:35.722953 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:35.723284 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:35.723737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:35.939402 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:35.943543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:35.952578 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c36ef07d-0db3-440e-9da1-50b34d796991 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.242950 Aug 10 22:52:35.953537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 362/736] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:35 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:35.954984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-79038cb9-64da-40bf-b9d1-869f174765bf tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1513 microversion: 2.1 time: 0.290612 Aug 10 22:52:35.955675 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 375/737] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:35 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:36.178480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:36.179410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:36.185575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.186388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.186836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:36.187542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.188030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.188454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:36.224768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:36.225424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:36.236561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.237163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.237644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:36.238376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.238937 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.239375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:36.383640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:36.392748 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:36.396875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:36.398152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8e9af590-31b1-4cb0-a16c-139315418a48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.223560 Aug 10 22:52:36.398720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 363/738] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:36 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:36.447535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:36.456555 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ca69f0d9-632b-4712-a431-61606ddc91d9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.235703 Aug 10 22:52:36.457148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 376/739] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:36 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:36.978343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:36.978952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:36.979630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:36.983385 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:36.986560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.987071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.987516 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:36.988232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.988695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.989124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:36.991433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.991993 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.992496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:36.993271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:36.994029 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:36.994333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:37.237666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:37.241480 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:37.246344 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-79c4037d-3dac-4f6c-bca1-4bc856ea5605 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.275745 Aug 10 22:52:37.247157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 364/740] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:36 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:37.248915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f1fe73b3-0da8-4d8c-b359-0617af7b36aa tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1513 microversion: 2.1 time: 0.276221 Aug 10 22:52:37.250810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 377/741] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:36 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:37.436358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:37.436982 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:37.444594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:37.445382 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:37.445838 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:37.446568 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:37.447034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:37.447466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:37.478838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:37.479460 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:37.487288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:37.487697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:37.488141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:37.488865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:37.493496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:37.494022 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:37.675579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:37.693262 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:37.695177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:37.696388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e7cb9f70-138f-4e32-836e-839c7df0f9c0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.274532 Aug 10 22:52:37.697324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 365/742] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:37 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:37.714628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:37.722676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fe32c653-7bb2-4898-a25a-f749f48ae192 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.247714 Aug 10 22:52:37.723244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 378/743] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:37 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:38.268299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:38.269194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:38.269350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:38.269967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:38.276472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.276667 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.277160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.277272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.277642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.278127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.278351 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.278812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.279132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.279269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.279707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.280211 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.522608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:38.522814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:38.522814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3bd52369-2480-46ec-a2a2-a35b8b9ecda7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.257856 Aug 10 22:52:38.532007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b8d1da98-fa63-4c02-b3b1-3c5c599c53a2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1513 microversion: 2.1 time: 0.264136 Aug 10 22:52:38.532007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 379/744] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:38 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:38.536664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 366/745] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:38 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:38.720171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:38.720792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:38.727186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.727680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.728121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.728832 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.729351 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.729884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.744234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:38.744948 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:38.753848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.754668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.755120 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.755835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:38.756489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:38.756927 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:38.997542 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:39.007312 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:39.013869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:39.015248 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-05ee4af5-9314-4701-9250-b666a33a3424 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.299232 Aug 10 22:52:39.033839 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 380/746] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:38 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:39.063843 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:39.074572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-16b52e78-091a-4f62-b856-9c0709315487 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.333968 Aug 10 22:52:39.075928 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 367/747] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:38 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:39.429182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-65817be3-d08b-403a-bdb0-8f8da508e9d8 req-04c803a2-23fc-437f-87d6-83b8442ec746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f0a50ab-30d2-4fab-aa58-fb2fff48956f", "name": "network-vif-deleted", "tag": "0f7e4895-9c79-4192-83be-039cf8918024"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:39.444413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-65817be3-d08b-403a-bdb0-8f8da508e9d8 req-04c803a2-23fc-437f-87d6-83b8442ec746 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:39.445155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-65817be3-d08b-403a-bdb0-8f8da508e9d8 req-04c803a2-23fc-437f-87d6-83b8442ec746 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:39.445605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-65817be3-d08b-403a-bdb0-8f8da508e9d8 req-04c803a2-23fc-437f-87d6-83b8442ec746 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:39.458222 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-65817be3-d08b-403a-bdb0-8f8da508e9d8 req-04c803a2-23fc-437f-87d6-83b8442ec746 service nova] Creating event network-vif-deleted:0f7e4895-9c79-4192-83be-039cf8918024 for instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f on hv-cinder-83608 Aug 10 22:52:39.465617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-65817be3-d08b-403a-bdb0-8f8da508e9d8 req-04c803a2-23fc-437f-87d6-83b8442ec746 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048241 Aug 10 22:52:39.467887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 381/748] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:39.543953 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:39.544605 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:39.552464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:39.553320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:39.563619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:39.564276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:39.564718 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:39.565466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:39.565921 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:39.566335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:39.568413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:39.569064 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:39.569768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:39.571015 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:39.571499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:39.571883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:39.617407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:39.618162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:39.619062 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:39.619962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lazy-loading 'fault' on Instance uuid 5f0a50ab-30d2-4fab-aa58-fb2fff48956f {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:52:39.693784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c2f531a5942e6afabb16521523754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38d0effe2b242bbb7ea221ec2da0177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:39.705363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8314c2fd-2e87-4335-9c33-43def8d86de2 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 200 len: 1307 microversion: 2.1 time: 0.157488 Aug 10 22:52:39.705964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 382/749] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:39 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:39.713411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-3d1c9d02-967a-4113-98bc-9eeb0125b7ff req-fe72acb3-c3dc-4e4a-a8c2-5cd6905d3421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5", "name": "network-vif-plugged", "status": "completed", "tag": "708f09d8-ca6d-45f9-a30a-a8c44395f181"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:39.733207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-3d1c9d02-967a-4113-98bc-9eeb0125b7ff req-fe72acb3-c3dc-4e4a-a8c2-5cd6905d3421 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:39.734955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-3d1c9d02-967a-4113-98bc-9eeb0125b7ff req-fe72acb3-c3dc-4e4a-a8c2-5cd6905d3421 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:39.735612 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-3d1c9d02-967a-4113-98bc-9eeb0125b7ff req-fe72acb3-c3dc-4e4a-a8c2-5cd6905d3421 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:39.748659 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-3d1c9d02-967a-4113-98bc-9eeb0125b7ff req-fe72acb3-c3dc-4e4a-a8c2-5cd6905d3421 service nova] Creating event network-vif-plugged:708f09d8-ca6d-45f9-a30a-a8c44395f181 for instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 on hv-cinder-83608 Aug 10 22:52:39.754772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-3d1c9d02-967a-4113-98bc-9eeb0125b7ff req-fe72acb3-c3dc-4e4a-a8c2-5cd6905d3421 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047629 Aug 10 22:52:39.755827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 383/750] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:39.827711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:39.838649 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-70a690c9-50fc-43be-8115-daeda7f6e1fb tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.298385 Aug 10 22:52:39.839406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 368/751] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:39 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:40.054466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:40.057478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:40.066226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.067081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.067955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:40.068470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.069337 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.073237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:40.099042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:40.099757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:40.105762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.113612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.114128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:40.114941 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.115454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.116035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:40.323735 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:40.348849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:40.350897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:40.353256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:40.354777 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-11e86264-652e-4739-88d7-287cd2b8622d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.314733 Aug 10 22:52:40.373876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2bf9796c-696f-424e-80ac-f8010ecc97ee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.271016 Aug 10 22:52:40.374447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 384/752] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:40 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:40.377268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 369/753] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:40 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:40.732902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:40.733525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] [instance: 5f0a50ab-30d2-4fab-aa58-fb2fff48956f] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:40.744178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.744925 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.745628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:40.746792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.747965 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.748286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:40.769388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] HTTP exception thrown: Instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f could not be found. Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Request method failure captured: Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f HTTP/1.1 Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DW2WPnjkpt7gUVzfwRog8RYklbV_zuO6YAgG3ajNTyDSGM1ofLhJyO1uD179JAgPX7DTVBcvrPq60f4jPNEw4t6UWlo9C_ew3uwG_4UxQHdwJXb19HtM1QaVOfuMrZ8wcv_iWWyZPm7bSXy3kNguJbJeGP27oDBlrm-Ud59J4KOG4w Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: c38d0effe2b242bbb7ea221ec2da0177 Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesSnapshotTestJSON-541983790 Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:52:40.770833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c38d0effe2b242bbb7ea221ec2da0177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c38d0effe2b242bbb7ea221ec2da0177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c38d0effe2b242bbb7ea221ec2da0177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c38d0effe2b242bbb7ea221ec2da0177"}]}] Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesSnapshotTestJSON-541983790 Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: c38d0effe2b242bbb7ea221ec2da0177 Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-541983790 Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesSnapshotTestJSON-541983790-project Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 0f3c2f531a5942e6afabb16521523754 Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesSnapshotTestJSON-541983790-project Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f could not be found. Aug 10 22:52:40.772817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '5f0a50ab-30d2-4fab-aa58-fb2fff48956f'} Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f could not be found. Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:52:40.774072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f could not be found. Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f could not be found. Aug 10 22:52:40.775597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:52:40.778890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] Returning 404 to user: Instance 5f0a50ab-30d2-4fab-aa58-fb2fff48956f could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:52:40.778890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a2330895-64f8-4a03-a33e-d76ace142ad0 tempest-VolumesSnapshotTestJSON-541983790 tempest-VolumesSnapshotTestJSON-541983790-project] 10.222.0.76 "GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f" status: 404 len: 111 microversion: 2.1 time: 0.049264 Aug 10 22:52:40.785489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 385/754] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:40 2022] GET /compute/v2.1/servers/5f0a50ab-30d2-4fab-aa58-fb2fff48956f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:52:40.861169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:40.861954 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:40.869167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.870853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.871626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:40.872572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:40.873341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:40.874268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:41.064617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:41.087053 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-80538dbc-3cbd-4a13-b6bc-9b5a68ca1c19 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.229530 Aug 10 22:52:41.102767 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 370/755] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:40 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:41.381899 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:41.383526 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:41.401705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:41.403678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:41.404499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:41.405226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:41.409344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:41.410003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:41.410726 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:41.411156 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:41.413025 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:41.413669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:41.414335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:41.420617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:41.422311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:41.423157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:41.649397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:41.650416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:41.662098 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:41.662314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-280ce07c-931b-4253-8f42-e6ecb03c3d2f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.267853 Aug 10 22:52:41.676466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 371/756] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:41 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:41.676682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:41.676682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bb4b6cfa-cd47-41c8-a911-dd39fc5e7bcb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.287790 Aug 10 22:52:41.676682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 386/757] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:41 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:42.181363 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:42.181974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:42.189708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:42.190232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:42.190701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:42.191419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:42.191876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:42.192300 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:42.392750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:42.404604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e1d977bb-c80e-4d52-b00a-1c60aa9c8088 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1367 microversion: 2.1 time: 0.291282 Aug 10 22:52:42.405341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 372/758] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:42 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:42.684395 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:42.685138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:42.688955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:42.689706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:42.693722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:42.694292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:42.694804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:42.695579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:42.696195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:42.696644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:42.696751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:42.697196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:42.697681 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:42.698584 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:42.699051 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:42.699479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:42.726797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:42.921746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:42.925789 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:42.926016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=100 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:42.931879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c6fc7a32-a8fc-41d1-87d6-a02780a9b592 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.251768 Aug 10 22:52:42.932534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 387/759] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:42 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:42.934124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:42.935691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:42.936789 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cb11becd-d39e-468a-83dd-3d92301b6db5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.251849 Aug 10 22:52:42.948133 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 373/760] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:42 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:43.429798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:43.430531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:43.436497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:43.437025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:43.437489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:43.438250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:43.438700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:43.439116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:43.568813 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:43.576130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-14e63c85-56c5-4c2a-b842-dd78000939fe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1556 microversion: 2.1 time: 0.150183 Aug 10 22:52:43.576687 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 388/761] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:43 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:43.596324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:43.596817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:43.599114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:43.604473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:43.604959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:43.605430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:43.606132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:43.606588 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:43.607016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:43.690275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a35d5d18-6ac3-473d-9bfd-c38a9dce9ae9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098248 Aug 10 22:52:43.690873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 374/762] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:52:43 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:43.959989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:43.960696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:43.966827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:43.967431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:43.967974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:43.969719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:43.970355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:43.970828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:44.061043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:44.061697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:44.068099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:44.068581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:44.069017 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:44.069736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:44.070190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:44.070614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:44.292560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:44.300715 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:44.302333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:44.303522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-260613c6-3e6f-4bf3-bd6d-765e1a882eed tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.347647 Aug 10 22:52:44.304092 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 375/763] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:43 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:44.326741 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:44.335660 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-46e912dc-c4e3-41c2-8acd-e6c846add328 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.385599 Aug 10 22:52:44.336244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 389/764] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:43 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:44.790464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-b9428c4c-d950-4c6f-ad7a-2c56d456a798 req-3832b79d-57dd-42a2-a5e4-f405a1b6559f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5", "tag": "708f09d8-ca6d-45f9-a30a-a8c44395f181"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:44.801803 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-b9428c4c-d950-4c6f-ad7a-2c56d456a798 req-3832b79d-57dd-42a2-a5e4-f405a1b6559f service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:44.802310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-b9428c4c-d950-4c6f-ad7a-2c56d456a798 req-3832b79d-57dd-42a2-a5e4-f405a1b6559f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:44.802817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-b9428c4c-d950-4c6f-ad7a-2c56d456a798 req-3832b79d-57dd-42a2-a5e4-f405a1b6559f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:44.814696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-b9428c4c-d950-4c6f-ad7a-2c56d456a798 req-3832b79d-57dd-42a2-a5e4-f405a1b6559f service nova] Creating event network-changed:708f09d8-ca6d-45f9-a30a-a8c44395f181 for instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 on hv-cinder-83608 Aug 10 22:52:44.819858 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-b9428c4c-d950-4c6f-ad7a-2c56d456a798 req-3832b79d-57dd-42a2-a5e4-f405a1b6559f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032979 Aug 10 22:52:44.820622 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 376/765] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:45.327654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:45.328437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:45.335228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:45.335722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:45.336161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:45.336874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:45.337427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:45.337797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:45.356983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:45.358347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:45.365387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:45.366015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:45.366545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:45.367350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:45.368118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:45.368647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:45.547120 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:45.553509 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:45.555351 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:45.557207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:45.558532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7e79e2f1-96ee-4f07-b708-e7c1849f2f6a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.235026 Aug 10 22:52:45.566327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 390/766] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:45 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:45.569244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-781c1a69-6933-45da-b4fc-7532240c5195 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.216458 Aug 10 22:52:45.576014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 377/767] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:45 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:46.583217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:46.583933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:46.590564 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:46.591064 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:46.591152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:46.591362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:46.591798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:46.592558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:46.593615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:46.594073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:46.599417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:46.599417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:46.599417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:46.600138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:46.600477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:46.600892 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:46.797593 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:46.805068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:46.805668 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:46.807180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:46.808346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-16dd4d5e-5d07-4587-8f5b-69ef3239311c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.229212 Aug 10 22:52:46.808904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 391/768] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:46 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:46.813210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-514f4c99-1c24-42bb-b9b8-6d4b79f0087b tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.226422 Aug 10 22:52:46.813793 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 378/769] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:46 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:47.832038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:47.832766 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:47.833582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:47.834181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:47.839819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:47.840313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:47.840427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:47.840786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:47.840899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:47.841369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:47.841525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:47.841979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:47.842103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:47.842407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:47.842519 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:47.843625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:48.294092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:48.297580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:48.302309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:48.303963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:48.305127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a572fca9-bdb8-4227-b986-e9a211d6b8e1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1736 microversion: 2.20 time: 0.477779 Aug 10 22:52:48.305480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-aa4fb918-b0fc-4c56-8c6d-a3091bb247f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.475678 Aug 10 22:52:48.305964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 392/770] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:47 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1736 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:48.306098 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 379/771] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:47 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:49.332371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:49.333089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:49.333229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:49.333736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:49.340710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:49.341624 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:49.342227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:49.343244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:49.343763 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:49.344058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:49.344383 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:49.344634 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:49.344948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:49.346060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:49.346182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:49.346578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:49.542663 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:49.548742 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:49.551979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:49.553817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:49.554980 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a5b29feb-cef9-4d88-a560-2042bdaa8da2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1718 microversion: 2.20 time: 0.226278 Aug 10 22:52:49.557054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 380/772] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:49 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1718 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:49.559319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-671314c9-d1a9-4bb8-b019-16c44d8ecd67 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.230809 Aug 10 22:52:49.559891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 393/773] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:49 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:50.579725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:50.580399 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:50.581722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:50.582331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:50.587012 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:50.587499 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:50.587955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:50.588652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:50.588778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:50.589128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:50.589237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:50.589576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:50.589677 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:50.590375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:50.590904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:50.591305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:50.784204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:50.788804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:50.792842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:50.794507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:50.796416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a366036d-2f74-4c52-847a-38f98a5acf0b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1718 microversion: 2.20 time: 0.220645 Aug 10 22:52:50.797319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 381/774] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:50 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1718 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:50.797541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-09c73717-9f35-49f7-86c8-b6444b55a9a6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1722 microversion: 2.1 time: 0.219548 Aug 10 22:52:50.798169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 394/775] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:50 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:51.818411 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:51.819010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:51.820021 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:51.821237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:51.825739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:51.826476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:51.827173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:51.828042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:51.828508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:51.828835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:51.829007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:51.829519 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:51.829729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:51.830229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:51.830680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:51.831108 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.044739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.052311 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.054377 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-861ae64c-4fa2-4be2-81db-47bbe724eb3d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1699 microversion: 2.1 time: 0.239721 Aug 10 22:52:52.055172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 382/776] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:51 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1699 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:52.060794 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.061177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-08b40a22-6d16-4290-8008-6d87670f53d7 req-18173065-90b1-4b1e-a86f-21cb02c28b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0", "name": "network-vif-unplugged", "status": "completed", "tag": "1090c7bb-79eb-4915-b7e9-12cdfafe465a"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:52.063441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.064618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-06d5bb93-21d4-450c-ad0f-6c8fd38a8293 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1721 microversion: 2.20 time: 0.248635 Aug 10 22:52:52.065360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 395/777] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:51 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:52.071258 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-08b40a22-6d16-4290-8008-6d87670f53d7 req-18173065-90b1-4b1e-a86f-21cb02c28b68 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.071972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-08b40a22-6d16-4290-8008-6d87670f53d7 req-18173065-90b1-4b1e-a86f-21cb02c28b68 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.072531 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-08b40a22-6d16-4290-8008-6d87670f53d7 req-18173065-90b1-4b1e-a86f-21cb02c28b68 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.077303 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6019c4d0-f7f4-41d0-aaa3-6024820cfab1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:52.083246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6019c4d0-f7f4-41d0-aaa3-6024820cfab1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.083930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6019c4d0-f7f4-41d0-aaa3-6024820cfab1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.084685 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6019c4d0-f7f4-41d0-aaa3-6024820cfab1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.084806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-08b40a22-6d16-4290-8008-6d87670f53d7 req-18173065-90b1-4b1e-a86f-21cb02c28b68 service nova] Creating event network-vif-unplugged:1090c7bb-79eb-4915-b7e9-12cdfafe465a for instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 on hv-cinder-83608 Aug 10 22:52:52.089910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-08b40a22-6d16-4290-8008-6d87670f53d7 req-18173065-90b1-4b1e-a86f-21cb02c28b68 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032214 Aug 10 22:52:52.090511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 383/778] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:52:52.096268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c162a766-bbfb-4110-ba97-9c10068b755e"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:52.098664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:52.104747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.105246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.105768 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.106478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.106938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.107368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.114041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6019c4d0-f7f4-41d0-aaa3-6024820cfab1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Going to try to start instance {{(pid=132540) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 22:52:52.164725 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6019c4d0-f7f4-41d0-aaa3-6024820cfab1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action" status: 202 len: 0 microversion: 2.1 time: 0.092113 Aug 10 22:52:52.165404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 396/779] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:52:52 2022] POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:52:52.173946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:52.174655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:52.180734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.181220 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.181691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.182392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.182850 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.183272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.348448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.357730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ed9b25ea-0548-4e81-8e34-2dacdaa05121 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1708 microversion: 2.1 time: 0.187943 Aug 10 22:52:52.358583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 397/780] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:52 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1708 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:52:52.435034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-84cf9303-e35c-4915-b4af-90c1c5ad5028 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343100 Aug 10 22:52:52.435725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 384/781] 10.222.0.76 () {62 vars in 1364 bytes} [Wed Aug 10 22:52:52 2022] POST /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:52:52.564929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:52:52.565507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:52.567696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=88 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:52.576088 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.576908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.578211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.579729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.580200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.580666 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.700371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132540) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 22:52:52.799197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4e113a7f-5088-4610-a806-89c477fedd3b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/action" status: 202 len: 0 microversion: 2.20 time: 0.238240 Aug 10 22:52:52.803145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 398/782] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 10 22:52:52 2022] POST /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:52:52.810877 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:52.811640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:52.820401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.821053 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.821236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.822293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:52.822826 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:52.823448 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:52.977125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.991034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.992539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:52.993723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-369d36e9-4a14-495f-8a55-aae2c49f5eb6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1747 microversion: 2.20 time: 0.187287 Aug 10 22:52:52.996165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 385/783] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:52 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1747 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:52:53.379028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:53.379651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:53.386265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:53.386751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:53.387221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:53.387913 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:53.388362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:53.388780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:53.530734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:53.539143 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-879c3d5e-b2e8-4099-89af-a3bced5f8114 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1708 microversion: 2.1 time: 0.163933 Aug 10 22:52:53.539725 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 399/784] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:53 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:54.020949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:54.021747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:54.028377 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:54.028874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:54.029414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:54.030662 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:54.031119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:54.031548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:54.178650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:54.187120 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:54.188620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:54.189824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-24c1317f-ba0d-4c99-9766-31940e3c0fa2 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1747 microversion: 2.20 time: 0.173038 Aug 10 22:52:54.190388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 386/785] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:54 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1747 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:54.559941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:54.560551 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:54.567263 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:54.567746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:54.568179 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:54.568863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:54.569342 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:54.569765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:54.709917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:54.718930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5ba95ab2-b147-488b-992e-485453d3f341 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1708 microversion: 2.1 time: 0.162701 Aug 10 22:52:54.719516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 400/786] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:54 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:55.212511 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:55.213170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:55.220218 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:55.220698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:55.221137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:55.221863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:55.222320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:55.222751 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:55.359697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:55.367799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:55.369328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:55.370513 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7ab64f2a-5f11-481f-a24f-16826451263b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1747 microversion: 2.20 time: 0.161918 Aug 10 22:52:55.371079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 387/787] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:55 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:55.740608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:55.741269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:55.747881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:55.748521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:55.748990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:55.749926 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:55.750381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:55.750911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:55.899416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:55.907799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5fbffe58-c8cb-4bed-9364-a196b55c9546 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1708 microversion: 2.1 time: 0.169955 Aug 10 22:52:55.907799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 401/788] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:55 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1708 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:56.394316 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:56.394938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:56.401560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:56.402044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:56.402483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:56.403172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:56.403625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:56.404050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:56.538412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:56.547304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:56.548788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:56.549967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-94846cbf-057b-4870-9853-814b104746d7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1747 microversion: 2.20 time: 0.159568 Aug 10 22:52:56.550525 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 388/789] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:56 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:56.927068 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:56.927772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:56.934363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:56.934890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:56.935331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:56.936277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:56.936736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:56.937198 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:56.956300 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:57.077741 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:57.085671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f2007480-1cff-460c-803f-70e4d317e8ca tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1708 microversion: 2.1 time: 0.162380 Aug 10 22:52:57.086232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 402/790] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:56 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:57.573016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:57.573651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:57.581305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:57.581816 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:57.582253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:57.582957 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:57.583414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:57.583843 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:57.586616 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:57.756935 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:57.767505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:57.769016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:57.770245 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-438952ea-9eaa-4eb0-807f-09fdab4d7ae1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1747 microversion: 2.20 time: 0.201080 Aug 10 22:52:57.770813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 389/791] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:57 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1747 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:58.108176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:58.108969 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:58.115129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:58.115603 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:58.116034 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:58.116749 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:58.117202 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:58.117649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:58.252082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:58.260084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4b02a4e1-efdf-4f0e-bbc3-458cb2ca8e12 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1708 microversion: 2.1 time: 0.156420 Aug 10 22:52:58.260652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 403/792] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:58 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:58.794567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:58.795337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:58.801728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:58.802216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:58.802647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:58.803347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:58.803795 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:58.804338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:58.936785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:58.946191 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:58.948078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:58.949955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-85eda763-eb4a-4d4a-be94-3c7ac476530b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1749 microversion: 2.20 time: 0.159239 Aug 10 22:52:58.950517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 390/793] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:58 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:52:59.281986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:59.283016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:59.288922 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:59.289429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:59.289864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:59.290556 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:59.290992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:59.291412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:59.437439 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:52:59.445646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5a613a39-8843-4edc-a43d-ffeb3e3696e6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1712 microversion: 2.1 time: 0.167700 Aug 10 22:52:59.446219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 404/794] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:52:59 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1712 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:52:59.974215 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:52:59.974941 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:52:59.981300 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:59.981926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:59.982951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:52:59.983825 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:52:59.984373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:52:59.984879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:00.126459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:00.134847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:00.136337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:00.137522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1541a2a0-6837-41ae-bd31-5186630c2885 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.167264 Aug 10 22:53:00.138096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 391/795] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:52:59 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:01.160966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:01.162279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:01.168906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:01.169424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:01.170570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:01.171479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:01.171929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:01.172355 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:01.343693 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:01.354567 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:01.356698 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:01.358612 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2c6391ec-8e55-4204-8d2d-9d7b1a332fe1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.201848 Aug 10 22:53:01.359689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 405/796] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:01 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:02.382064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:02.382756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:02.390153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:02.391141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:02.391920 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:02.393152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:02.394015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:02.394777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:02.551209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:02.563354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:02.564847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:02.566042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4229ff29-3b93-4997-b134-de0cd4ee1831 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.187932 Aug 10 22:53:02.566638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 392/797] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:02 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:03.593549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:03.594160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:03.600953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:03.601472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:03.601913 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:03.602618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:03.603071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:03.603493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:03.751186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:03.759796 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:03.761536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:03.763659 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-10803e0b-f591-48bb-87d5-3b05e5425434 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.174036 Aug 10 22:53:03.764427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 406/798] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:03 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:04.786422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:04.786962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:04.793333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:04.793828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:04.794320 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:04.795134 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:04.795589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:04.796017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:04.935848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:04.945148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:04.949639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:04.951848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4f5b88f1-2bb9-4a28-8443-b87da14363d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.169594 Aug 10 22:53:04.952903 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 393/799] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:04 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:05.976194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:05.976807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:05.984364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:05.984851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:05.985310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:05.986009 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:05.986466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:05.986896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:06.126418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:06.135369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:06.136881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:06.138393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-56eb8bc9-f5fc-4221-9da7-7bdbb1da82ad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.165902 Aug 10 22:53:06.138987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 407/800] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:05 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:07.160936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:07.161581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:07.168124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:07.168610 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:07.169226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:07.170198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:07.170660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:07.171091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:07.313182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:07.322679 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:07.324168 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:07.325406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4f367251-1331-4072-a671-8b1ff4162dad tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.168572 Aug 10 22:53:07.325969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 394/801] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:07 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:08.349876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:08.350980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:08.360661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:08.361295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:08.361803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:08.362568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:08.363089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:08.363691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:08.504229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:08.516538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:08.518194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:08.519509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-438275ea-6893-420c-a0f1-8c33d8e355c5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.174036 Aug 10 22:53:08.520073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 408/802] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:08 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:53:09.544166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:09.546284 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:09.561091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:09.562066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:09.562767 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:09.563754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:09.564447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:09.565085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:09.751000 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:09.760046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:09.761983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:09.763698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b11fd41e-b3a1-4943-8acb-99906271b1ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.224360 Aug 10 22:53:09.764482 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 395/803] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:09 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:10.788130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:10.789589 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:10.796883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:10.806511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:10.808842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:10.810237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:10.810792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:10.811239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:10.957775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:10.967185 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:10.969616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:10.971289 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-971fc84f-7490-4624-86d8-dacc0532751d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.187268 Aug 10 22:53:10.986914 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 409/804] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:10 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:11.998085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:11.998683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:12.004939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:12.005453 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:12.005889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:12.006625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:12.007022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:12.007440 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:12.162001 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:12.173022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:12.174590 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:12.176206 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bd98cdf4-8179-4764-bb07-927b52b7b053 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.181934 Aug 10 22:53:12.177315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 396/805] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:11 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:13.207159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:13.208093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:13.217602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:13.218336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:13.219141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:13.220746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:13.221670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:13.222526 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:13.380286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:13.389319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:13.390871 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:13.392249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1ddd21e5-2c53-4d36-a46e-301e7400746b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.191777 Aug 10 22:53:13.393137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 410/806] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:13 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:53:14.416365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:14.416970 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:14.420041 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=46 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:14.425380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:14.425873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:14.426311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:14.427020 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:14.427475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:14.427901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:14.558234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:14.566675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:14.568185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:14.569376 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a7e34298-e4eb-4838-b68d-9daec81ad81a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.156831 Aug 10 22:53:14.570304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 397/807] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:14 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:15.593435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:15.594046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:15.600685 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:15.601162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:15.601627 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:15.602310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:15.602757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:15.603175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:15.738144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:15.746694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:15.747904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:15.749048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cf565353-08b6-49aa-850c-38ed614f7c33 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.159761 Aug 10 22:53:15.749643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 411/808] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:15 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:16.771692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:16.772315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:16.779193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:16.779627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:16.780065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:16.780760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:16.781210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:16.781664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:16.918426 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:16.926802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:16.928340 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:16.929531 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ab0461fd-e5f5-4892-ab7f-1d576e4f41bb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.161824 Aug 10 22:53:16.937809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 398/809] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:16 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:17.955218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:17.955826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:17.962221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:17.962705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:17.963142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:17.963829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:17.964288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:17.964775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:18.099562 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:18.108269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:18.109803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:18.110964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-38e5e5fd-250d-4b0d-8ef9-a9bb9b8535cb tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.159727 Aug 10 22:53:18.111524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 412/810] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:17 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:19.134641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:19.135243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:19.142243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:19.142722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:19.143150 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:19.143834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:19.144284 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:19.144702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:19.293729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:19.302339 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:19.303834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:19.304985 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-eaee6c3f-b9d9-4c20-8f16-0ecb0cc32336 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.174220 Aug 10 22:53:19.305575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 399/811] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:19 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:20.328249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:20.328885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:20.335231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:20.335704 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:20.336136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:20.336816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:20.337257 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:20.337697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:20.470084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:20.478383 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:20.479875 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:20.481023 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3836e020-be51-4235-8e6f-2d259c61a877 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.157002 Aug 10 22:53:20.482249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 413/812] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:20 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:21.505250 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:21.505887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:21.512413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:21.512906 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:21.513366 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:21.514065 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:21.514521 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:21.514942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:21.643287 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:21.651598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:21.653696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:21.654847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-046edd75-5844-45a8-a01a-34f28345da82 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.153874 Aug 10 22:53:21.655409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 400/813] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:21 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:22.677870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:22.678486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:22.680757 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:22.686922 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:22.687400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:22.687839 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:22.688532 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:22.688985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:22.689440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:22.823801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:22.832782 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:22.834359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:22.835530 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8b96e718-96dd-44eb-ae13-0f5ce4f8bd38 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.161630 Aug 10 22:53:22.836101 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 414/814] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:22 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:23.859803 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:23.860418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:23.866813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:23.867298 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:23.867740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:23.868438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:23.868893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:23.869338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:24.006072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:24.014361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:24.015841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:24.017037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cbefe3a5-05d7-4fef-9394-cbc062a10d22 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.162145 Aug 10 22:53:24.017573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 401/815] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:23 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:25.042164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:25.042773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:25.049814 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:25.050233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:25.050671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:25.051364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:25.051817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:25.052241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:25.183413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:25.192377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:25.193904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:25.195054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d2cce0e7-8648-4460-bf4a-6da96ce8250e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.156804 Aug 10 22:53:25.195613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 415/816] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:25 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:26.217935 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:26.218520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:26.224527 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:26.225012 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:26.225483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:26.226170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:26.226625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:26.227049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:26.362930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:26.371831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:26.373558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:26.374717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9f3ee50c-55d2-4819-b4b3-97c1b4b246b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.160821 Aug 10 22:53:26.375265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 402/817] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:26 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:27.399668 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:27.400272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:27.407473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:27.407948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:27.408381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:27.409064 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:27.409541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:27.409960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:27.412448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=81 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:27.538788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:27.547337 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:27.548833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:27.550033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-667b8ae2-5941-42c9-8ea1-1af14d9d79be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.154212 Aug 10 22:53:27.550593 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 416/818] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:27 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:28.573232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:28.573867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:28.580987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:28.581492 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:28.581931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:28.582623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:28.583077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:28.583502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:28.586027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=84 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:28.725460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:28.736020 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:28.737684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:28.738968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ba52d61f-2ce2-4431-a289-c804eb04e6a5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.169643 Aug 10 22:53:28.739598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 403/819] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:28 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:29.763822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:29.764679 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:29.771206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:29.771689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:29.772126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:29.772821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:29.773363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:29.773724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:29.908478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:29.916974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:29.918489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:29.919767 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6d491540-dd85-48ed-b9a5-3426e53dc54b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.160784 Aug 10 22:53:29.920332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 417/820] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:29 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:30.942351 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:30.942956 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:30.949483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:30.949964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:30.950400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:30.951224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:30.951747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:30.952173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:31.083093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:31.091617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:31.093136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:31.094301 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-25159766-381b-4372-9aad-813c195d2913 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.155845 Aug 10 22:53:31.094860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 404/821] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:30 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:32.117680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:32.118278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:32.125241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:32.125750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:32.126186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:32.126927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:32.127334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:32.127892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:32.260541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:32.269973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:32.271420 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:32.272581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a8539631-33d9-4b4d-b5d3-883db3eff8e6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.158902 Aug 10 22:53:32.273136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 418/822] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:32 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:33.296161 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:33.296777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:33.304540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:33.305038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:33.305498 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:33.306277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:33.306734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:33.307555 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:33.441711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:33.450114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:33.452162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:33.453376 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-09b5b913-82d7-456d-aff7-b4126cbfef0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.161427 Aug 10 22:53:33.453894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 405/823] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:33 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:34.478265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:34.479055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:34.485857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:34.486424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:34.486778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:34.487483 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:34.487919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:34.488397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:34.624687 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:34.633150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:34.634701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:34.635858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0e8c88dc-21a2-47f0-9d1a-87f00b7ab800 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.162675 Aug 10 22:53:34.636417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 419/824] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:34 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:35.659821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:35.660439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:35.666698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:35.667184 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:35.667622 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:35.668315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:35.668768 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:35.669727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:35.801775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:35.811246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:35.812761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:35.813967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2491dc39-1e18-410d-811a-2d1c8f7ffac3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.158337 Aug 10 22:53:35.814530 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 406/825] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:35 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:36.689618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-d873b31e-e0ec-4398-945d-bc3886c56fa4 req-d9a3aa57-df51-48fd-8ee6-589761e92c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0", "name": "network-vif-plugged", "status": "completed", "tag": "1090c7bb-79eb-4915-b7e9-12cdfafe465a"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:53:36.699086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d873b31e-e0ec-4398-945d-bc3886c56fa4 req-d9a3aa57-df51-48fd-8ee6-589761e92c1e service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:36.699565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d873b31e-e0ec-4398-945d-bc3886c56fa4 req-d9a3aa57-df51-48fd-8ee6-589761e92c1e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:36.699996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d873b31e-e0ec-4398-945d-bc3886c56fa4 req-d9a3aa57-df51-48fd-8ee6-589761e92c1e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:36.711102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-d873b31e-e0ec-4398-945d-bc3886c56fa4 req-d9a3aa57-df51-48fd-8ee6-589761e92c1e service nova] Creating event network-vif-plugged:1090c7bb-79eb-4915-b7e9-12cdfafe465a for instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 on hv-cinder-83608 Aug 10 22:53:36.716831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-d873b31e-e0ec-4398-945d-bc3886c56fa4 req-d9a3aa57-df51-48fd-8ee6-589761e92c1e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151968 Aug 10 22:53:36.717447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 420/826] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:53:36.836012 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:36.836620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:36.843701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:36.844185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:36.844626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:36.845385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:36.845900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:36.846326 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:36.977692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:36.986075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:36.987628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:36.988760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-690905dd-1403-4a40-96bd-08ada96a7c69 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.156658 Aug 10 22:53:36.990734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 407/827] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:36 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:38.015104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:38.016316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:38.023696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:38.024191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:38.024634 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:38.025360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:38.025818 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:38.026243 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:38.163540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:38.171939 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:38.173472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:38.174638 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d79e6931-6f9e-4b05-92ec-95c01e0b82a0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.165818 Aug 10 22:53:38.175192 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 421/828] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:38 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:39.198691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:39.199270 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:39.206037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:39.206533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:39.206974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:39.207689 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:39.208149 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:39.208578 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:39.341114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:39.349840 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:39.351331 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:39.352490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-571aa9c4-034b-4478-b601-7c8bbbbf3f07 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.157883 Aug 10 22:53:39.353054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 408/829] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:39 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:40.376320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:40.376968 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:40.383386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:40.383871 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:40.384315 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:40.385186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:40.385518 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:40.386023 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:40.551766 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:40.560300 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:40.561835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:40.563011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-15d8a85f-0ac0-4f13-b760-324b10ed5930 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1805 microversion: 2.20 time: 0.191127 Aug 10 22:53:40.564036 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 422/830] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:40 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1805 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:41.585842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:41.586520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:53:41.593671 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:41.594154 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:41.594593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:41.595284 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:41.595835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:41.596262 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:41.724978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:41.733605 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:41.735137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:53:41.736294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6f536e73-4564-4a29-bb4e-1bdb1b151a9a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1792 microversion: 2.20 time: 0.154372 Aug 10 22:53:41.736850 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 409/831] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:53:41 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1792 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:54:21.049135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:54:21.051471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:21.053575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=17 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:21.054245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=37 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:21.060138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:21.060619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:21.061054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:21.062429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:21.062884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:21.063307 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:21.134696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3ded0d87-377e-4910-b5f2-e12b48cdedf5 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/action" status: 202 len: 0 microversion: 2.1 time: 0.089937 Aug 10 22:54:21.135370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 423/832] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:54:21 2022] POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:54:21.204752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:21.205543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:21.207589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=25 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:21.208241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=41 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:21.215357 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:21.219444 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:21.219882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:21.220754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:21.221252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:21.222729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:21.367926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:21.376568 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8c03421f-5bed-45f1-bf2f-d74e62137463 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1750 microversion: 2.1 time: 0.176265 Aug 10 22:54:21.377162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 410/833] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:21 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:22.399369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:22.400063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:22.407219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:22.407700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:22.408134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:22.408822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:22.409273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:22.409722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:22.562435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:22.570365 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ad4fe331-9298-4288-bc29-1043719d36d0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.175777 Aug 10 22:54:22.570934 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 424/834] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:22 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:54:23.592121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:23.593572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:23.600072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:23.600563 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:23.601004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:23.601747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:23.602208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:23.602637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:23.748461 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:23.757588 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2cbc7684-64b9-43f4-913a-09aedf6607a2 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.169307 Aug 10 22:54:23.758178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 411/835] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:23 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:24.778686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:24.779226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:24.786512 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:24.786991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:24.787424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:24.788108 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:24.788554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:24.788975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:24.934715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:24.942703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f392c61e-e744-4dbd-91cb-8b6babfe242b tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.168277 Aug 10 22:54:24.943271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 425/836] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:24 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:25.963808 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:25.964454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:25.971057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:25.971545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:25.971986 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:25.972680 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:25.973135 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:25.973597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:26.117460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:26.125606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d8b2b941-5885-4d86-8528-16dba1ee92b6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.165726 Aug 10 22:54:26.126191 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 412/837] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:25 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:27.146514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:27.147159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:27.153830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:27.154319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:27.154953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:27.155807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:27.156271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:27.156701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:27.299956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:27.308007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c1992adc-4579-4eff-86e6-244d8b261052 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.165388 Aug 10 22:54:27.308584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 426/838] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:27 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:28.329581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:28.330229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:28.336692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:28.337176 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:28.337645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:28.338341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:28.338799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:28.339247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:28.484962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:28.492944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-47a488b3-910a-4ae8-838f-9214b5c97c0d tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.167797 Aug 10 22:54:28.493541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 413/839] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:28 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:29.514938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:29.515548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:29.522087 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:29.522566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:29.522997 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:29.523684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:29.524135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:29.524554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:29.678243 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:29.686770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c6670353-14af-48b3-bd1a-5c48807bcc22 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.176097 Aug 10 22:54:29.687236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 427/840] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:29 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:30.707762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:30.708313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:30.714633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:30.715112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:30.715546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:30.716227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:30.717273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:30.717830 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:30.862658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:30.870544 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e8c16b8a-c48b-4c41-afc3-64b6f8dc90a9 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.166763 Aug 10 22:54:30.871110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 414/841] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:30 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:31.892016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:31.892626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:31.899541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:31.900027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:31.900744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:31.901529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:31.901984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:31.902407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:32.053140 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:32.061881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3ae1f6ba-17e0-462e-bb7b-bbb799e12901 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.174124 Aug 10 22:54:32.062458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 428/842] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:31 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:32.878754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:32.879293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:32.885873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:32.886278 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:32.886721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:32.887419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:32.887878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:32.888307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:32.969794 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lazy-loading 'services' on Instance uuid 05b5a255-e068-46e0-8c6d-bdde4a91c933 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:54:33.046196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-26ce4488-5eb6-4797-856b-08ecdabdef21 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-volume_attachments/f5a1a5fb-1553-4c31-9018-753e4da44879" status: 202 len: 0 microversion: 2.1 time: 0.171274 Aug 10 22:54:33.046830 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 415/843] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:54:32 2022] DELETE /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-volume_attachments/f5a1a5fb-1553-4c31-9018-753e4da44879 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:54:33.083810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:33.084486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:33.092279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:33.093262 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:33.093776 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:33.095389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:33.096074 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:33.096510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:33.244421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:33.253066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9dce9047-315b-49d4-ba6b-76a45d7bbd53 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.173903 Aug 10 22:54:33.253670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 429/844] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:33 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:34.275804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:34.276464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:34.283188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:34.283674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:34.284115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:34.284814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:34.285392 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:34.285723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:34.429829 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:34.438594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b9e7a8fa-8b7e-493b-9349-5c3d08feacec tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.167433 Aug 10 22:54:34.439165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 416/845] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:34 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:35.225150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1667aad4-b085-4ea0-bfea-b1f164a19a72 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:54:35.231589 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1667aad4-b085-4ea0-bfea-b1f164a19a72 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:35.232748 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1667aad4-b085-4ea0-bfea-b1f164a19a72 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:35.233182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1667aad4-b085-4ea0-bfea-b1f164a19a72 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:35.254292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1667aad4-b085-4ea0-bfea-b1f164a19a72 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Going to try to stop instance {{(pid=132540) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 22:54:35.295076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1667aad4-b085-4ea0-bfea-b1f164a19a72 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action" status: 202 len: 0 microversion: 2.1 time: 0.073295 Aug 10 22:54:35.295631 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 430/846] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:54:35 2022] POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:54:35.303924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:35.304558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:35.311024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:35.311533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:35.311965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:35.312674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:35.313147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:35.313702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:35.446407 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:35.454449 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-073574b4-4167-427b-8597-7245d1e87d5e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.154444 Aug 10 22:54:35.455021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 417/847] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:35 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:35.461170 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:35.461902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:35.468869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:35.469392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:35.469830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:35.470524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:35.470976 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:35.471400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:35.614186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:35.622050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-65980cfe-9b05-4b84-b0c7-b596a25de985 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.165100 Aug 10 22:54:35.623118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 431/848] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:35 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:36.475891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:36.476495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:36.483482 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:36.483961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:36.484391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:36.485075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:36.485554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:36.485973 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:36.616876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:36.624420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-30868281-f54d-4b9e-ae54-48eee18fffe4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.152409 Aug 10 22:54:36.624989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 418/849] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:36 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:36.643273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:36.643926 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:36.650656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:36.651142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:36.651582 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:36.652276 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:36.652733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:36.653159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:36.801919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:36.810648 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5f832568-1d3e-4fa5-99c8-18f5d103a3fc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1755 microversion: 2.1 time: 0.170434 Aug 10 22:54:36.811471 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 432/850] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:36 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:37.645027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:37.645659 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:37.652689 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:37.653178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:37.653962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:37.654979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:37.654979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:37.655459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:37.786148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:37.793523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9231898d-1dcb-47ba-9190-0e60a284c754 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.152563 Aug 10 22:54:37.794402 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 419/851] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:37 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:37.831763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:37.832376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:37.838787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:37.839269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:37.839707 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:37.840404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:37.841561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:37.842157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:37.989224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:37.997946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-90be676c-6df3-48f0-b4e6-080ac24fe6c7 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1758 microversion: 2.1 time: 0.169223 Aug 10 22:54:37.998235 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 433/852] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:37 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:38.815708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:38.816256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:38.822538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:38.823028 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:38.823460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:38.824145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:38.824599 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:38.825024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:38.958088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:38.965505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-40798d71-32d7-47af-b879-f3ac5b1f9cfb tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.154316 Aug 10 22:54:38.966102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 420/853] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:38 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:39.986896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:39.987504 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:39.993851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:39.994386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:39.994878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:39.995558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:39.996007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:39.996428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:40.127334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:40.135203 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-67720a49-7784-4c16-8f54-f58038d8f389 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.152150 Aug 10 22:54:40.136001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 434/854] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:39 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:41.156900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:41.157533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:41.163892 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:41.164377 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:41.164810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:41.165536 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:41.166086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:41.166570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:41.301380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:41.308729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-874b0e64-a36e-4db2-9f80-2780d0772b10 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.155851 Aug 10 22:54:41.309298 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 421/855] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:41 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:42.329959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:42.330661 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:42.336924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:42.337464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:42.337886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:42.338614 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:42.339072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:42.339502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:42.361947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff3deb6e-3648-43e0-b45b-d6c9896b68d3"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:54:42.364393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:42.370266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:42.370745 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:42.371175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:42.371865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:42.372318 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:42.372737 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:42.475341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:42.485147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6cf2c5fe-ec47-4a58-b078-3d69bc1441d1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.159063 Aug 10 22:54:42.485768 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 422/856] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:42 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:54:42.627200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3ea7dd03-82fd-453e-98de-679105473a14 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431658 Aug 10 22:54:42.627812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 435/857] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:54:42 2022] POST /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:54:43.507185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:43.507809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:43.514942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:43.515416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:43.515851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:43.516539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:43.516988 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:43.517446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:43.647201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:43.655878 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-233c18cf-9aa3-46f5-ba59-e801203df721 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.152265 Aug 10 22:54:43.656470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 423/858] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:43 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:44.677822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:44.678511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:44.685105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:44.686096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:44.686872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:44.687897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:44.688602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:44.689044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:44.693244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:44.822819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:44.830864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c44df4b8-4faa-4bc7-8f33-f6f004ab15bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.157257 Aug 10 22:54:44.831434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 436/859] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:44 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:45.851794 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:45.852405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:45.859026 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:45.859506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:45.859940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:45.860626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:45.861076 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:45.861531 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:46.002759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:46.010316 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-575d6521-f5df-432d-af61-6c09b1284240 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.162335 Aug 10 22:54:46.010879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 424/860] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:45 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:47.034551 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:47.035157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:47.041657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:47.042137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:47.042565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:47.043245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:47.043693 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:47.044111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:47.173016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:47.180937 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5b6f8db8-4f37-45dd-87e3-a976bf78777f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.150216 Aug 10 22:54:47.181531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 437/861] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:47 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:48.204034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:48.204579 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:48.210910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:48.211396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:48.211860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:48.212544 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:48.212998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:48.213454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:48.341396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:48.346010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:48.350547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4a55a197-b89f-4890-8ff6-9f7ddc270a4d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.151452 Aug 10 22:54:48.351130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 425/862] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:48 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:49.371852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:49.372468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:49.379738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:49.380223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:49.380671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:49.381392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:49.381901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:49.382326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:49.748276 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:49.755885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-30028693-562a-4cc0-a037-2425fe121998 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1676 microversion: 2.1 time: 0.387945 Aug 10 22:54:49.756453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 438/863] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:49 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1676 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:50.153342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:54:50.155771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:50.163268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:50.163850 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:50.164289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:50.164993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:50.165472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:50.165898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:50.189006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lazy-loading 'flavor' on Instance uuid d918f389-4e74-4995-91c3-a16be1f17b0b {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:54:50.314632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-442eaa08-ab6e-42ce-8aad-d343178351ec tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/action" status: 200 len: 32 microversion: 2.1 time: 0.165393 Aug 10 22:54:50.315173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 426/864] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:54:50 2022] POST /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:54:50.324646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:50.325254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:50.331357 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:50.331845 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:50.332285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:50.333013 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:50.333464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:50.333896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:50.471106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:50.479147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fc29ebd1-9b03-407c-be54-ea4d92286df3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.158229 Aug 10 22:54:50.479730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 439/865] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:50 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:50.778512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:50.779379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:50.785871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:50.786364 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:50.786804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:50.787519 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:50.787974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:50.788406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:50.923375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:50.930857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cab67e84-697b-4655-9fbd-0696c5a1641e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1653 microversion: 2.1 time: 0.156867 Aug 10 22:54:50.931428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 427/866] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:50 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:50.952940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f31951f8-07c7-4ae9-a27d-0ebd8f6f4edf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:54:50.959099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f31951f8-07c7-4ae9-a27d-0ebd8f6f4edf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:50.959586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f31951f8-07c7-4ae9-a27d-0ebd8f6f4edf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:50.960020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f31951f8-07c7-4ae9-a27d-0ebd8f6f4edf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:50.983959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f31951f8-07c7-4ae9-a27d-0ebd8f6f4edf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Going to try to start instance {{(pid=132540) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 22:54:51.027516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f31951f8-07c7-4ae9-a27d-0ebd8f6f4edf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action" status: 202 len: 0 microversion: 2.1 time: 0.079180 Aug 10 22:54:51.028120 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 440/867] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:54:50 2022] POST /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:54:51.037947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:51.038673 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:51.045380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:51.046913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:51.046913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:51.047215 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:51.047646 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:51.048077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:51.190586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:51.201804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-82aebdf1-586f-4cf4-a4e5-fba9068e8ab4 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1662 microversion: 2.1 time: 0.168097 Aug 10 22:54:51.202416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 428/868] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:51 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:51.501390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:51.502088 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:51.504013 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=37 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:51.509505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:51.510000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:51.510436 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:51.511132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:51.511590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:51.512074 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:51.648604 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:51.664223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d7e9e83d-bce0-4f5c-934d-1e1bed2135f8 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.167523 Aug 10 22:54:51.664831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 441/869] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:51 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:52.224412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:52.225207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:52.227154 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=39 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:52.233743 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:52.234236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:52.234728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:52.235576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:52.236103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:52.236528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:52.366262 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:52.373898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-69e24811-982b-42de-8857-d20ddd14ca3f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1662 microversion: 2.1 time: 0.154159 Aug 10 22:54:52.374507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 429/870] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:52 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:52.691435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:52.692042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:52.698516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:52.699061 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:52.699499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:52.700185 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:52.701161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:52.701637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:52.830861 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:52.838805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-95689e17-6832-452b-b3b9-6ca01f5149ff tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.151140 Aug 10 22:54:52.839410 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 442/871] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:52 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:53.395253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:53.395835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:53.402380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:53.402857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:53.403287 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:53.404000 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:53.404451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:53.404861 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:53.536273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:53.543812 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ba1701d1-2407-494d-9434-e5f3299f51a9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1666 microversion: 2.1 time: 0.152406 Aug 10 22:54:53.544406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 430/872] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:53 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:53.860509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:53.861148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:53.867516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:53.868169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:53.868774 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:53.869502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:53.869959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:53.870386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:54.000558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:54.008563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c7b7f76a-a4a0-4759-ba6d-e1bdfa3eec98 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.152003 Aug 10 22:54:54.009073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 443/873] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:53 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:55.030181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:55.030756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:55.038885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:55.039373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:55.039809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:55.040540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:55.040996 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:55.041452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:55.172520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:55.180533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-001fac59-7322-40fd-9837-9079da984f67 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.154759 Aug 10 22:54:55.181104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 431/874] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:55 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:56.204176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:56.204791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:56.211212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:56.211694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:56.212135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:56.212822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:56.213296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:56.213728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:56.340853 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:56.348945 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ae30b08c-ae75-4a6b-9c10-eb51f60564f3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.149425 Aug 10 22:54:56.349554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 444/875] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:56 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:57.370373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:57.370987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:57.377723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:57.378216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:57.378657 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:57.379356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:57.379817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:57.380254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:57.508737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:57.516832 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ec1de20e-3a9d-48db-b49c-670bacda066b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.150288 Aug 10 22:54:57.517438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 432/876] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:57 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:58.538192 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:58.538829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:58.545841 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:58.546320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:58.546752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:58.547432 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:58.547879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:58.548295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:58.685397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:58.693475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b586db60-2b81-4a5e-8177-5a7444207ea2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.159083 Aug 10 22:54:58.694045 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 445/877] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:58 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:54:59.716714 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:54:59.717267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:54:59.723678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:59.724170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:59.724613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:59.725332 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:59.725792 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:59.726225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:59.861468 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:54:59.869487 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a2afd58d-b2bd-44ee-8e1f-3d306da9dfcc tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.157364 Aug 10 22:54:59.870155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 433/878] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:54:59 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:00.891628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:00.892259 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:00.899035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:00.899522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:00.899963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:00.900658 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:00.901120 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:00.901587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.036276 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:01.045061 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1f9ce964-1369-4469-a657-707040540096 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.157828 Aug 10 22:55:01.046024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 446/879] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:00 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:01.217007 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:01.217632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:01.224159 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.224849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.225158 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.226061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.226360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.226856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.250508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3cf3637a-3762-4e35-b934-9df3f1e3d357 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5/ips" status: 200 len: 149 microversion: 2.1 time: 0.037937 Aug 10 22:55:01.251115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 434/880] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:55:01 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:01.263244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "604868ab-03e0-4203-96f8-f5dbcc842d6b"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:01.265809 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:01.271639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.272116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.272548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.273513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.273980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.274382 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.352093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Invalid volume: volume 604868ab-03e0-4203-96f8-f5dbcc842d6b is already attached to instances: cecaf930-d7cc-4ee7-b096-6f206dc50e7a Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: POST /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5/os-volume_attachments HTTP/1.1 Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 74 Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:55:01.353862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {"volumeAttachment": {"volumeId": "604868ab-03e0-4203-96f8-f5dbcc842d6b"}} Aug 10 22:55:01.355470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Invalid volume: volume 604868ab-03e0-4203-96f8-f5dbcc842d6b is already attached to instances: cecaf930-d7cc-4ee7-b096-6f206dc50e7a Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'server_id': 'e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5', 'body': {'volumeAttachment': {'volumeId': '604868ab-03e0-4203-96f8-f5dbcc842d6b'}}} Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 604868ab-03e0-4203-96f8-f5dbcc842d6b is already attached to instances: cecaf930-d7cc-4ee7-b096-6f206dc50e7a Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:01.356417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 604868ab-03e0-4203-96f8-f5dbcc842d6b is already attached to instances: cecaf930-d7cc-4ee7-b096-6f206dc50e7a Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:01.357992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 604868ab-03e0-4203-96f8-f5dbcc842d6b is already attached to instances: cecaf930-d7cc-4ee7-b096-6f206dc50e7a Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 400 to user: Invalid volume: volume 604868ab-03e0-4203-96f8-f5dbcc842d6b is already attached to instances: cecaf930-d7cc-4ee7-b096-6f206dc50e7a {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3365047b-d368-41ca-a83f-26289179d4a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096904 Aug 10 22:55:01.359428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 447/881] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:55:01 2022] POST /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 22:55:01.364114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:01.364607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:01.370715 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.371203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.372179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.372958 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.373447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.373876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.399327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:55:01.461692 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:01.462219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:01.470077 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.470645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.471093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.472980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.473485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.473920 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.491939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1e0ee293-da37-4f67-83af-a2c341f7c488 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 204 len: 0 microversion: 2.1 time: 0.131101 Aug 10 22:55:01.492618 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 435/882] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:55:01 2022] DELETE /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:55:01.502224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:01.503014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:01.508947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.509469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.509906 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.510606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.511060 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.511483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.512682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e0d8447e-a44b-4bb3-ae42-b81c01d7536f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments/c162a766-bbfb-4110-ba97-9c10068b755e" status: 200 len: 194 microversion: 2.20 time: 0.055453 Aug 10 22:55:01.513573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 448/883] 10.222.0.76 () {60 vars in 1454 bytes} [Wed Aug 10 22:55:01 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments/c162a766-bbfb-4110-ba97-9c10068b755e => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:55:01.590686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:01.591237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:01.597158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.597676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.598107 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.598799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.599250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.599669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.647379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:01.656266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5d47ce3e-8017-45dd-9542-d68c9b14a18a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1681 microversion: 2.1 time: 0.158143 Aug 10 22:55:01.656844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 436/884] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:01 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:01.721740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lazy-loading 'services' on Instance uuid 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:55:01.835290 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8a25bec3-7d80-47be-9f30-a27993c1df79 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments/c162a766-bbfb-4110-ba97-9c10068b755e" status: 202 len: 0 microversion: 2.20 time: 0.248399 Aug 10 22:55:01.835881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 449/885] 10.222.0.76 () {60 vars in 1457 bytes} [Wed Aug 10 22:55:01 2022] DELETE /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments/c162a766-bbfb-4110-ba97-9c10068b755e => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:55:01.845489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:01.847761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:01.854023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.854532 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.854965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.855699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:01.856217 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:01.856646 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:01.885639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9a92d81f-961c-4258-be23-7729cc590b00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045197 Aug 10 22:55:01.886194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 437/886] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 10 22:55:01 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:55:02.076558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:02.077194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:02.083278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:02.083758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:02.084212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:02.084881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:02.085357 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:02.085780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:02.222233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:02.230444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-03bbbae6-5e7b-483d-b6e9-fe37c703c506 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.159162 Aug 10 22:55:02.231507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 450/887] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:02 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:02.678641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:02.679397 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:02.686076 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:02.686504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:02.686941 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:02.687634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:02.688090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:02.688514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:02.834438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:02.842437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fa83adb8-ccb5-47e7-9407-9beac9fbd01d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1681 microversion: 2.1 time: 0.167614 Aug 10 22:55:02.843020 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 438/888] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:02 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:02.898195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:02.900455 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:02.907183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:02.907667 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:02.908135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:02.908824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:02.909301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:02.909723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:02.913380 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:02.940810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e07fed6b-7336-41df-91a4-c8ffe8b27043 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046739 Aug 10 22:55:02.941295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 451/889] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 10 22:55:02 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:03.252600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:03.253127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:03.258989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:03.259467 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:03.259900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:03.260580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:03.261027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:03.261470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:03.266087 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:03.394930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:03.402976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bd5877e4-e67a-4a69-a97e-ae4679ad684b tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.154202 Aug 10 22:55:03.403534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 439/890] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:03 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:03.863911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:03.864674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:03.871905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:03.872712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:03.873174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:03.873943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:03.874403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:03.874836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:03.954010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:03.956122 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:03.963690 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:03.964179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:03.964615 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:03.965936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:03.966388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:03.966811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:04.003866 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-41a3d1d4-a725-4465-b1d5-f31f4b305ed5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054502 Aug 10 22:55:04.004778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 440/891] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 10 22:55:03 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:55:04.030918 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:04.039375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-86ccae01-aa81-4b52-80fb-88501a53960d tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1681 microversion: 2.1 time: 0.179193 Aug 10 22:55:04.047867 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 452/892] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:03 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:04.424330 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:04.424959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:04.431810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:04.432187 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:04.432876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:04.433625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:04.434597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:04.435363 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:04.571666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:04.579959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6c893c95-42b3-4b8d-8fde-131d1102821e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.159491 Aug 10 22:55:04.580538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 441/893] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:04 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:04.740917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-123071dd-a0e4-45ef-8e30-c08dfb089387 req-206444e2-66a2-4428-8df9-bba09b16b51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5", "name": "network-vif-deleted", "tag": "708f09d8-ca6d-45f9-a30a-a8c44395f181"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:04.754160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-123071dd-a0e4-45ef-8e30-c08dfb089387 req-206444e2-66a2-4428-8df9-bba09b16b51f service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:04.754738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-123071dd-a0e4-45ef-8e30-c08dfb089387 req-206444e2-66a2-4428-8df9-bba09b16b51f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:04.755443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-123071dd-a0e4-45ef-8e30-c08dfb089387 req-206444e2-66a2-4428-8df9-bba09b16b51f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:04.770653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-123071dd-a0e4-45ef-8e30-c08dfb089387 req-206444e2-66a2-4428-8df9-bba09b16b51f service nova] Creating event network-vif-deleted:708f09d8-ca6d-45f9-a30a-a8c44395f181 for instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 on hv-cinder-83608 Aug 10 22:55:04.775876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-123071dd-a0e4-45ef-8e30-c08dfb089387 req-206444e2-66a2-4428-8df9-bba09b16b51f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105632 Aug 10 22:55:04.776649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 453/894] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:05.016881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:05.019089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:05.025254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.025716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.026148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.026845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.027296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.028874 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.059995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-edca5d57-a7d4-4719-aaba-9288486d7664 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047477 Aug 10 22:55:05.060572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 442/895] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 10 22:55:05 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:05.069142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:05.069781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:05.077619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.078122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.080286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.081678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.082148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.082590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.121563 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.122125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.122630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.123145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lazy-loading 'fault' on Instance uuid e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:55:05.139867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:05.140693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:05.148385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.149506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.150044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.151028 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.151587 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.152261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.190244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:05.193784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:55:05.198517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3715ed0f-1bb7-40e1-9e52-9d886079c894 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 200 len: 1332 microversion: 2.1 time: 0.134159 Aug 10 22:55:05.213731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 454/896] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:05 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 1332 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:05.326433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7b799756-957a-4899-9dcd-a0fef2399e53 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 204 len: 0 microversion: 2.20 time: 0.191505 Aug 10 22:55:05.327091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 443/897] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 10 22:55:05 2022] DELETE /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 22:55:05.336201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:05.336739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:05.343084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.343676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.344313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.345029 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.345513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.346059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.524340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:05.537340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:05.539485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:05.540764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-92bf1d44-d5f8-47ae-96ba-0b08acb2eb7f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.208625 Aug 10 22:55:05.541388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 455/898] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:05 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:05.605173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:05.606738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:05.616885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.617668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.618422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.619554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:05.620348 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:05.621880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:05.795912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:05.807285 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-300e00a5-a969-4e4f-b023-405cdbf9406f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.209044 Aug 10 22:55:05.817383 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 444/899] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:05 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:06.222054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:06.223298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:06.229973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:06.230974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:06.231412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:06.232142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:06.232602 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:06.233024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:06.247721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 HTTP/1.1 Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:55:06.249376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 22:55:06.250951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5'} Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:06.251761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 22:55:06.253229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:06.254966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:06.254966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-50771e95-8a03-4e6e-a986-f11327be1dba tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 404 len: 111 microversion: 2.1 time: 0.032621 Aug 10 22:55:06.254966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 456/900] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:06 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:06.259927 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b5666b5a-cbbe-4e3f-b8de-6448574fae4f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '.version_select at 0x7fa9be5db700>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:06.280687 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b5666b5a-cbbe-4e3f-b8de-6448574fae4f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637457234" status: 202 len: 0 microversion: 2.1 time: 0.024502 Aug 10 22:55:06.281472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 445/901] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 10 22:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637457234 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:06.566948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:06.567114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:06.573114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:06.573624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:06.574054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:06.574897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:06.575377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:06.575809 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:06.822041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:06.833551 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:06.834576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:06.844277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:06.845365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:06.846285 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:06.847748 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:06.848508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:06.849112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:06.850938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:06.853091 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:06.860740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-05091d93-844a-41e0-a559-4b43838efc1d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.297008 Aug 10 22:55:06.870824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 457/902] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:06 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:07.106547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:07.115179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-68b882a4-7917-4692-abf1-9b9f27f1f09d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.287053 Aug 10 22:55:07.140696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 446/903] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:06 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:07.209525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:07.209951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:07.215849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:07.216316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:07.216744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:07.217453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:07.217900 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:07.218314 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:07.298014 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lazy-loading 'services' on Instance uuid cecaf930-d7cc-4ee7-b096-6f206dc50e7a {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:55:07.368330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b2d918d0-85f4-45a2-88ca-59abee6a3554 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments/604868ab-03e0-4203-96f8-f5dbcc842d6b" status: 202 len: 0 microversion: 2.1 time: 0.162727 Aug 10 22:55:07.368908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 458/904] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:55:07 2022] DELETE /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments/604868ab-03e0-4203-96f8-f5dbcc842d6b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:07.378138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:07.380384 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:07.387286 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:07.387770 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:07.388197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:07.388882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:07.389356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:07.389775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:07.418850 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b229e4e5-32a0-4f26-9bec-071c1c93765e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Aug 10 22:55:07.419416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 447/905] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:07 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:07.894564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:07.895256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:07.901749 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:07.902237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:07.902668 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:07.903443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:07.903897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:07.904322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:08.036594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:08.046676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:08.048193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:08.049367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-413a136b-a390-4481-983f-5d7dadfe0e87 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.159040 Aug 10 22:55:08.049916 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 459/906] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:07 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:08.141319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:08.142062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:08.148483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:08.148898 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:08.149364 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:08.150049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:08.150498 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:08.150915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:08.281814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:08.289660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-76730333-41ee-40aa-9754-816a544faf41 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.153519 Aug 10 22:55:08.290227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 448/907] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:08 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:08.431411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:08.434529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:08.440974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:08.441501 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:08.441943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:08.442643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:08.443099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:08.443526 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:08.472326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-30f23f32-d8c9-43eb-9e94-6376a7a97289 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Aug 10 22:55:08.472886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 460/908] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:08 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:09.076710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:09.077969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:09.086285 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:09.087906 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:09.088552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:09.089593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:09.090720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:09.091312 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:09.288023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:09.299374 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:09.300932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:09.302355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c1fbfcc8-e22c-4aca-bd65-214e12971d16 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1720 microversion: 2.20 time: 0.233651 Aug 10 22:55:09.302924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 449/909] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:09 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:09.313045 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:09.314071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:09.322040 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:09.322903 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:09.323343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:09.324307 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:09.324795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:09.325209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:09.483205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:09.484962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:09.487833 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:09.491924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-53283259-d7ab-4699-8e06-8a01ea904cc2 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.184153 Aug 10 22:55:09.494048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:09.494547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:09.494983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:09.495692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:09.496761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:09.497265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:09.507372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 461/910] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:09 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:09.536522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a9bc9a10-d95f-4aa0-8c2d-6127b2f52462 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056288 Aug 10 22:55:09.537091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 450/911] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:09 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:10.186515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-a2f5ae2f-3529-4780-b343-ee95a31a881f req-f777a517-1537-45d4-87d7-1c6736596ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0", "name": "network-vif-deleted", "tag": "1090c7bb-79eb-4915-b7e9-12cdfafe465a"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:10.196524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-a2f5ae2f-3529-4780-b343-ee95a31a881f req-f777a517-1537-45d4-87d7-1c6736596ae3 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:10.197376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-a2f5ae2f-3529-4780-b343-ee95a31a881f req-f777a517-1537-45d4-87d7-1c6736596ae3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:10.197904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-a2f5ae2f-3529-4780-b343-ee95a31a881f req-f777a517-1537-45d4-87d7-1c6736596ae3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:10.209691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-a2f5ae2f-3529-4780-b343-ee95a31a881f req-f777a517-1537-45d4-87d7-1c6736596ae3 service nova] Creating event network-vif-deleted:1090c7bb-79eb-4915-b7e9-12cdfafe465a for instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 on hv-cinder-83608 Aug 10 22:55:10.216415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-a2f5ae2f-3529-4780-b343-ee95a31a881f req-f777a517-1537-45d4-87d7-1c6736596ae3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Aug 10 22:55:10.220130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 462/912] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:10.327576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:10.328564 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:10.336110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:10.336876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:10.337563 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:10.338436 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:10.339117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:10.340131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:10.407514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:10.415393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:10.416918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:10.418694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-769ee929-3aab-4ff0-87b9-896f6ec5322f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1653 microversion: 2.20 time: 0.095357 Aug 10 22:55:10.419437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 451/913] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:10 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:10.517926 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:10.518630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:10.525191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:10.525711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:10.526155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:10.527680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:10.528127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:10.528617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:10.550222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:10.552454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:10.559739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:10.560471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:10.561067 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:10.572720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:10.577820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:10.578956 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:10.638706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7d4c4166-983d-4b0b-9e5d-3026eb7cfae6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092142 Aug 10 22:55:10.640476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 452/914] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:10 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:10.677263 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:10.687513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d2ce73eb-33b2-4eef-b7b6-499824899beb tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1737 microversion: 2.1 time: 0.173658 Aug 10 22:55:10.688568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 463/915] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:10 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:11.442533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:11.443143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:11.449824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.450311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.450750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.451450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.452078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.452514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.630975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.631465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.631903 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.632351 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lazy-loading 'fault' on Instance uuid 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:55:11.652573 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:11.654794 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:11.662262 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.663025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.663966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.665010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.665734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.666181 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.675156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:11.683918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:11.685775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:11.686944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b132664d-54d3-435c-a831-526bd4832421 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 200 len: 1369 microversion: 2.20 time: 0.248551 Aug 10 22:55:11.687738 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 453/916] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:11 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:11.704487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-94692440-444e-4b37-8211-6baef47a1306 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054953 Aug 10 22:55:11.705118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 464/917] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:11 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 22:55:11.714070 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:11.715747 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:11.722116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.722741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.723200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.723931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.724464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.724887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.775938 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:11.776528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:11.783949 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.784514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.785038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.785837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.786362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.786852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.812955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:55:11.864067 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:11.867778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:11.874504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7dc38526-d53f-4412-87c1-c0988536de96 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1717 microversion: 2.1 time: 0.169041 Aug 10 22:55:11.875082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 454/918] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:11 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:11.909103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-10b81afa-91ba-4a11-a154-32285bd30593 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 204 len: 0 microversion: 2.1 time: 0.137113 Aug 10 22:55:11.910024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 465/919] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:55:11 2022] DELETE /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:55:11.919415 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:11.920041 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:11.927569 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.928062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.928502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.929204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.929696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.930125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.940571 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:11.941133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:11.947636 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.948122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.948574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:11.950446 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:11.950913 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:11.951350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:12.033811 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] HTTP exception thrown: Cannot 'detach_volume' instance d918f389-4e74-4995-91c3-a16be1f17b0b while it is in vm_state rescued Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Request method failure captured: Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments/ff3deb6e-3648-43e0-b45b-d6c9896b68d3 HTTP/1.1 Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DYCKYlw68MXeAFmR5fqjvgrUqsL0n9nwTLmQ4I0_7dW16ug4hl5z_6m1p5BJHDmMIW15DDQ9G-MLcnqSWMYvvl4Qjz-oHmnyqlwHJ1qwqOfIHNBN67OnMnYgOErpG0KHmKLwItc1eXMIM1qX6-BSzEwE_1d5cTANt1kIG_sbezjXBY Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:55:12.035488 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}] Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 6367371496f04cc2a7c105fbbed68dca Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:55:12.036964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Cannot 'detach_volume' instance d918f389-4e74-4995-91c3-a16be1f17b0b while it is in vm_state rescued Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'server_id': 'd918f389-4e74-4995-91c3-a16be1f17b0b', 'id': 'ff3deb6e-3648-43e0-b45b-d6c9896b68d3'} Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d918f389-4e74-4995-91c3-a16be1f17b0b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:12.038020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d918f389-4e74-4995-91c3-a16be1f17b0b while it is in vm_state rescued Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d918f389-4e74-4995-91c3-a16be1f17b0b while it is in vm_state rescued Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.039327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Returning 409 to user: Cannot 'detach_volume' instance d918f389-4e74-4995-91c3-a16be1f17b0b while it is in vm_state rescued {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:12.040291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d9c8dbda-678b-42c0-a9ff-68b2ed835f44 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments/ff3deb6e-3648-43e0-b45b-d6c9896b68d3" status: 409 len: 152 microversion: 2.1 time: 0.101051 Aug 10 22:55:12.040291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 466/920] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:55:11 2022] DELETE /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments/ff3deb6e-3648-43e0-b45b-d6c9896b68d3 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 22:55:12.046438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:12.047047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:12.053457 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:12.054033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:12.054427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:12.055111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:12.055570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:12.055996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:12.060712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:12.067222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:12.074945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-15a712c0-4bb7-4f5c-bf23-d3ab2832aefd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1680 microversion: 2.1 time: 0.160243 Aug 10 22:55:12.075585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 455/921] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:11 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:12.124214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3cd1f805-6d24-4f29-8faf-4ad7d121c6ba tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "POST /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.081903 Aug 10 22:55:12.125030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 467/922] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:55:12 2022] POST /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:12.132863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:12.133497 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:12.140918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:12.141736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:12.142185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:12.142895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:12.143357 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:12.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:12.279406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:12.287613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a23ec0cc-2e01-4ae8-85cc-2ba1a0b59cf3 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1725 microversion: 2.1 time: 0.158452 Aug 10 22:55:12.288248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 456/923] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:12 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:12.710566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:12.711402 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:12.719375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:12.719870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:12.720318 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:12.721019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:12.721515 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:12.721946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:12.736082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] HTTP exception thrown: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Request method failure captured: Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 HTTP/1.1 Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWElqe5EPxwZoSSPP7pZuUmZm46PCO9ULgfbGVW9GeSXjzEvu9BcsCWt5DI73wYVM76VMYD4GDaic1sbdbBw5Ny-hJgv2zrGMFTOQ-eMV7hyWIig7614OTlDLrEYYcCdDf_-h1tkM_yld8WbBihqyBXfWLk4xI0V4LLJYT426euFHM Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:55:12.737669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a4e2567825f44d938dfbf7e043015367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}] Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 12e6b0b71ecb4825aeab6735eb44e63e Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 22:55:12.739389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0'} Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:12.740459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 22:55:12.742102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:12.743479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Returning 404 to user: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:12.743479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-188dcbde-f95c-427b-942b-58db4cacad94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 404 len: 111 microversion: 2.20 time: 0.032777 Aug 10 22:55:12.743479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 468/924] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:12 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:55:12.747933 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-27fbb9ed-3941-455a-8433-869053d74635 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '.version_select at 0x7fa9be63fca0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:12.771365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-27fbb9ed-3941-455a-8433-869053d74635 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-32758888" status: 204 len: 0 microversion: 2.20 time: 0.027157 Aug 10 22:55:12.772215 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 457/925] 10.222.0.76 () {60 vars in 1256 bytes} [Wed Aug 10 22:55:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-32758888 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 22:55:13.096717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:13.097461 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:13.104075 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:13.104714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:13.105877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:13.106861 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:13.107377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:13.107864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:13.310939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:13.311826 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:13.318284 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:13.319265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:13.319919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:13.320567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:13.321362 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:13.321968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:13.322548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:13.332024 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5fb7fbc9-3869-4ed9-ba4b-bec41abdaf5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1680 microversion: 2.1 time: 0.239184 Aug 10 22:55:13.333683 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 469/926] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:13 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:13.598158 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:13.611238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cbaba03b-5e60-4e66-a680-e2cc6a8edc2a tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1725 microversion: 2.1 time: 0.301830 Aug 10 22:55:13.611238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 458/927] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:13 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:13.658451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-030121fa-c584-4d9d-96d1-f1b9a6acbee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'create', calling method: .version_select at 0x7fa9c2f5f9d0>, body: {"keypair": {"name": "tempest-keypair-705297778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzVYOeKnj5FBbTGOoHhTwcxv0f1eJ297sWpytK1h5TNjjMBkzEvDLmCYUAZyQKUbQQ+vAMmTy+1+S4XbFwmIkM+LlaVjDmWivynDIo/SlKEDHlTq6ho6sHsg7C3Sw1UCg=="}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:13.674986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-030121fa-c584-4d9d-96d1-f1b9a6acbee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for project a4e2567825f44d938dfbf7e043015367. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:55:13.678903 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-030121fa-c584-4d9d-96d1-f1b9a6acbee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for user 12e6b0b71ecb4825aeab6735eb44e63e and project a4e2567825f44d938dfbf7e043015367. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:55:13.705267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-030121fa-c584-4d9d-96d1-f1b9a6acbee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050823 Aug 10 22:55:13.707245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 470/928] 10.222.0.76 () {62 vars in 1200 bytes} [Wed Aug 10 22:55:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 22:55:14.022520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-2c5771ec-e4a3-4648-b04f-402081d2f059 req-a725b278-01dc-4f9b-8125-fd79c01daaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cecaf930-d7cc-4ee7-b096-6f206dc50e7a", "name": "network-vif-deleted", "tag": "fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:14.033882 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-2c5771ec-e4a3-4648-b04f-402081d2f059 req-a725b278-01dc-4f9b-8125-fd79c01daaee service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:14.035103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-2c5771ec-e4a3-4648-b04f-402081d2f059 req-a725b278-01dc-4f9b-8125-fd79c01daaee service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:14.035728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-2c5771ec-e4a3-4648-b04f-402081d2f059 req-a725b278-01dc-4f9b-8125-fd79c01daaee service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:14.048563 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-2c5771ec-e4a3-4648-b04f-402081d2f059 req-a725b278-01dc-4f9b-8125-fd79c01daaee service nova] Creating event network-vif-deleted:fbc0e5e8-9a8c-46fe-8f27-f3de89f58a9d for instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a on hv-cinder-83608 Aug 10 22:55:14.056957 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-2c5771ec-e4a3-4648-b04f-402081d2f059 req-a725b278-01dc-4f9b-8125-fd79c01daaee service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040612 Aug 10 22:55:14.058071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 459/929] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:14.356251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:14.357490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:14.368901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:14.369265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:14.369795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:14.371871 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:14.372489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:14.372896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:14.444756 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:14.453360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f21c8604-c808-4d59-9234-9ee4f035eb81 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1613 microversion: 2.1 time: 0.102612 Aug 10 22:55:14.454158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 471/930] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:14 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:14.629827 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:14.630522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:14.638288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:14.638955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:14.639396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:14.640116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:14.640571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:14.641058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:14.806266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:14.815732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a4064fa5-4927-46a7-ba9f-9cef7360059e tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1725 microversion: 2.1 time: 0.189942 Aug 10 22:55:14.816746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 460/931] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:14 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:15.193144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1700307294", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bd44dd4-585b-4b02-807c-85cd9220aa1f"}], "security_groups": [{"name": "tempest-securitygroup--253351755"}], "key_name": "tempest-keypair-705297778", "user_data": "}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:15.311610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] validate_networks() for [('6bd44dd4-585b-4b02-807c-85cd9220aa1f', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:55:15.474098 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:15.474894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:15.482462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:15.483031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:15.483549 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:15.484267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:15.484733 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:15.485167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:15.528954 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:15.529473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:15.529916 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:15.530367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lazy-loading 'fault' on Instance uuid cecaf930-d7cc-4ee7-b096-6f206dc50e7a {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:55:15.588144 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:15.596975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a0817c3e-878a-4e54-af9b-483784701be5 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 200 len: 1332 microversion: 2.1 time: 0.126721 Aug 10 22:55:15.601948 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 461/932] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:15 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:15.719908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:55:15.720393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:55:15.720779 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:55:15.721180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:55:15.721617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:55:15.730229 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:15.730699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:15.731123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:15.731838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:15.732286 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:15.732697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:15.748858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for project a4e2567825f44d938dfbf7e043015367. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:55:15.752642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Getting quotas for user 12e6b0b71ecb4825aeab6735eb44e63e and project a4e2567825f44d938dfbf7e043015367. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:55:15.763806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:55:15.766041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:55:15.811922 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3dcb3a01-5cd3-4c4e-a0e8-014f0f17c2d1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.622972 Aug 10 22:55:15.818420 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 472/933] 10.222.0.76 () {62 vars in 1188 bytes} [Wed Aug 10 22:55:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 22:55:15.836204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-403e69d2-0ccf-4cad-833e-d8b52de7547d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:15.841020 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-403e69d2-0ccf-4cad-833e-d8b52de7547d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:15.846967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:15.847782 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:15.857773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:15.858436 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:15.858895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:15.859611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:15.860065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:15.860580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:15.955221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-403e69d2-0ccf-4cad-833e-d8b52de7547d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:15.963495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-403e69d2-0ccf-4cad-833e-d8b52de7547d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:15.965824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-403e69d2-0ccf-4cad-833e-d8b52de7547d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:15.966941 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-403e69d2-0ccf-4cad-833e-d8b52de7547d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1281 microversion: 2.20 time: 0.146096 Aug 10 22:55:15.967491 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 462/934] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:15 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1281 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:16.029574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:16.037993 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0fb35a68-3910-46f4-8891-752ec8e3aaae tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1731 microversion: 2.1 time: 0.195482 Aug 10 22:55:16.038662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 473/935] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:15 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:16.060160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:16.060648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:16.066739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:16.067224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:16.067676 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:16.068985 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:16.068985 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:16.069209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:16.148148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bd8ee657-bb28-4d8a-848b-661e5f05bbf7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092567 Aug 10 22:55:16.149250 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 463/936] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:55:16 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:16.623759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:16.624369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:16.627036 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:16.632444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:16.632936 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:16.633421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:16.634209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:16.634671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:16.635105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:16.651443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a HTTP/1.1 Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:55:16.653479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 22:55:16.654881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'cecaf930-d7cc-4ee7-b096-6f206dc50e7a'} Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:16.655628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 22:55:16.657054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:16.658180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:16.658180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-72bf2845-8a7a-47b9-b5e5-a43f453f5741 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 404 len: 111 microversion: 2.1 time: 0.036518 Aug 10 22:55:16.658180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 474/937] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:16 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:16.664562 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ba7f5e2c-1da1-4a03-aaee-42d6a87a1522 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '.version_select at 0x7fa9be6085e0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:16.685769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ba7f5e2c-1da1-4a03-aaee-42d6a87a1522 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172576208" status: 202 len: 0 microversion: 2.1 time: 0.025347 Aug 10 22:55:16.686354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 464/938] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 10 22:55:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172576208 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:16.990116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:16.990738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:16.997367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:16.997857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:16.998294 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:16.998998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:16.999448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:17.000063 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:17.091206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:17.100528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:17.102699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:17.103931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-270e3c2a-98d4-4d6d-a5e5-8845a2ef34d0 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1341 microversion: 2.20 time: 0.118021 Aug 10 22:55:17.104888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 475/939] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:16 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1341 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:17.791077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-468d63bc-4f35-47bb-b084-1500592721c2 req-d346be88-ed57-40cc-b290-aeb6bb77fb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d918f389-4e74-4995-91c3-a16be1f17b0b", "tag": "4e93fd28-7dd8-4ea3-93a6-89f48468b295"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:17.803801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-468d63bc-4f35-47bb-b084-1500592721c2 req-d346be88-ed57-40cc-b290-aeb6bb77fb19 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:17.804289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-468d63bc-4f35-47bb-b084-1500592721c2 req-d346be88-ed57-40cc-b290-aeb6bb77fb19 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:17.804735 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-468d63bc-4f35-47bb-b084-1500592721c2 req-d346be88-ed57-40cc-b290-aeb6bb77fb19 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:17.816070 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-468d63bc-4f35-47bb-b084-1500592721c2 req-d346be88-ed57-40cc-b290-aeb6bb77fb19 service nova] Creating event network-changed:4e93fd28-7dd8-4ea3-93a6-89f48468b295 for instance d918f389-4e74-4995-91c3-a16be1f17b0b on hv-cinder-83608 Aug 10 22:55:17.821746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-468d63bc-4f35-47bb-b084-1500592721c2 req-d346be88-ed57-40cc-b290-aeb6bb77fb19 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034770 Aug 10 22:55:17.822348 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 465/940] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:18.127963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:18.129332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:18.141026 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:18.141555 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:18.142126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:18.142932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:18.143475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:18.143917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:18.201729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-51ffe985-6a67-4652-a0ec-25296063b348 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: .version_select at 0x7fa9be5bbaf0>, body: {"keypair": {"name": "tempest-keypair-1227424170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXN005veu5eThxJNJLnaf3o3yzlyAe44DnGoE/o8hf7FGs5RAgPD4MlTp32gYiZ+mp0QJcWy838Z+JjxT4IXtdzzCxj3TuHi/0FneDnY/C7/FsO+MXR38eMaVmSxkk6DQ=="}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:18.215558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:18.229014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-51ffe985-6a67-4652-a0ec-25296063b348 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:55:18.236264 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-51ffe985-6a67-4652-a0ec-25296063b348 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:55:18.269621 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-51ffe985-6a67-4652-a0ec-25296063b348 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075435 Aug 10 22:55:18.278333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 466/941] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:55:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:18.310751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:18.327475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:18.329394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:18.332377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2eb74890-b2c6-4bd0-ae4b-fd8188ef39dc tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1339 microversion: 2.20 time: 0.207144 Aug 10 22:55:18.333822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 476/942] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:18 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1339 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:19.356645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:19.358050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:19.364622 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:19.365341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:19.365900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:19.366678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:19.367305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:19.367737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:19.565364 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:19.574742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:19.576451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:19.577648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a020083b-3f5f-4051-be28-7a21c4151c8c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.225523 Aug 10 22:55:19.578510 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 467/943] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:19 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:19.844222 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-5b68fa1c-a419-4fde-8622-60de32f4dfbc req-bb6387ea-b8be-4667-b7ea-9bccebd320c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d918f389-4e74-4995-91c3-a16be1f17b0b", "tag": "4e93fd28-7dd8-4ea3-93a6-89f48468b295"}, {"name": "network-changed", "server_uuid": "063e1bb3-65ab-404d-b358-0b580e3559d9", "tag": "cee28bdd-1335-44c1-9da4-99dfff6ebedf"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:19.855148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5b68fa1c-a419-4fde-8622-60de32f4dfbc req-bb6387ea-b8be-4667-b7ea-9bccebd320c5 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:19.855613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5b68fa1c-a419-4fde-8622-60de32f4dfbc req-bb6387ea-b8be-4667-b7ea-9bccebd320c5 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:19.856035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5b68fa1c-a419-4fde-8622-60de32f4dfbc req-bb6387ea-b8be-4667-b7ea-9bccebd320c5 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:19.871320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-5b68fa1c-a419-4fde-8622-60de32f4dfbc req-bb6387ea-b8be-4667-b7ea-9bccebd320c5 service nova] Creating event network-changed:4e93fd28-7dd8-4ea3-93a6-89f48468b295 for instance d918f389-4e74-4995-91c3-a16be1f17b0b on hv-cinder-83608 Aug 10 22:55:19.871837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-5b68fa1c-a419-4fde-8622-60de32f4dfbc req-bb6387ea-b8be-4667-b7ea-9bccebd320c5 service nova] Creating event network-changed:cee28bdd-1335-44c1-9da4-99dfff6ebedf for instance 063e1bb3-65ab-404d-b358-0b580e3559d9 on hv-cinder-83608 Aug 10 22:55:19.878210 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-5b68fa1c-a419-4fde-8622-60de32f4dfbc req-bb6387ea-b8be-4667-b7ea-9bccebd320c5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037611 Aug 10 22:55:19.878815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 477/944] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:19.907116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1940923213", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67b001b8-3d70-41ad-865c-43e8ac074765"}], "security_groups": [{"name": "tempest-securitygroup--480037585"}], "key_name": "tempest-keypair-1227424170", "user_data": "}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:20.008979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] validate_networks() for [('67b001b8-3d70-41ad-865c-43e8ac074765', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:55:20.603044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:20.603832 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:20.610646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:20.611132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:20.611578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:20.612321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:20.612772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:20.613190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:20.787595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:55:20.788115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:55:20.788598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:55:20.789130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:55:20.789637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:55:20.801713 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:20.802260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:20.803149 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:20.803820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:20.804368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:20.805125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:20.815237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:20.823553 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:20.824966 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:55:20.825114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:20.826236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-83ac87a5-d3c8-4530-a859-d73840362529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.227441 Aug 10 22:55:20.826791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 478/945] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:20 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:55:20.829488 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:55:20.843098 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:55:20.845420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:55:20.894925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-803bb649-35a4-4a9e-afa8-7a909f7a778f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.991881 Aug 10 22:55:20.895492 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 468/946] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:55:20.908213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7da00050-0efb-42b5-a603-95e31d92710b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:20.908829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7da00050-0efb-42b5-a603-95e31d92710b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:20.967859 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7da00050-0efb-42b5-a603-95e31d92710b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:20.974449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7da00050-0efb-42b5-a603-95e31d92710b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1242 microversion: 2.1 time: 0.070288 Aug 10 22:55:20.975398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 479/947] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:20 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:21.848523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:21.849141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:21.855958 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:21.856452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:21.856896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:21.857669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:21.858134 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:21.858566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:21.990378 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:21.994033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:21.994773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:21.998949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:22.000443 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:22.001635 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-eac95048-f8a5-4554-a2f8-d02476a81a86 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.157502 Aug 10 22:55:22.002096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:22.002261 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 469/948] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:21 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:22.002590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:22.003109 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:22.003821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:22.004576 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:22.005014 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:22.067450 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:22.075733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cb773ae1-878f-4996-afa9-d7c70d49c7d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1246 microversion: 2.1 time: 0.085433 Aug 10 22:55:22.076302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 480/949] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:21 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:23.027388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:23.028028 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:23.035272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:23.036435 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:23.037263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:23.038395 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:23.039069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:23.039760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:23.106753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:23.110394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:23.124720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:23.126440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:23.127647 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:23.129585 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:23.131800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:23.133121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:23.269857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:23.278458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-27a9fc48-871b-41ed-b266-5cf5a668ed62 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1312 microversion: 2.1 time: 0.184344 Aug 10 22:55:23.279373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 481/950] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:23 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:23.298445 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:23.306894 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:23.308856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:23.310006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1ad10ca9-6ade-4675-963b-03fdb29744ab tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.289399 Aug 10 22:55:23.310570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 470/951] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:23 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:24.300457 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:24.301046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:24.308603 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:24.309096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:24.309614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:24.310308 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:24.310765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:24.311195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:24.334466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:24.335082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:24.343550 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:24.344369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:24.344817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:24.345580 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:24.346043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:24.346472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:24.628979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:24.638045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:24.639638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:24.640900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cfb1fad3-ddf7-44f8-be34-a730ab5f4b10 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.311007 Aug 10 22:55:24.641567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 471/952] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:24 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:55:24.696943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:24.705513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f9beabae-de11-4c5f-8d92-00db886dcfc7 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.409037 Aug 10 22:55:24.706253 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 482/953] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:24 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:24.864310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-8670d5f4-ad7a-4185-8648-8abc4d4bcb10 req-8d04195c-3c85-4174-b6e4-5e599e276889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27093fe9-e428-4e9d-b997-dc252de8ae3d", "tag": "07da3b5f-f66e-485e-8d5c-51d2fe563c69"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:24.874172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8670d5f4-ad7a-4185-8648-8abc4d4bcb10 req-8d04195c-3c85-4174-b6e4-5e599e276889 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:24.874585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8670d5f4-ad7a-4185-8648-8abc4d4bcb10 req-8d04195c-3c85-4174-b6e4-5e599e276889 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:24.875010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8670d5f4-ad7a-4185-8648-8abc4d4bcb10 req-8d04195c-3c85-4174-b6e4-5e599e276889 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:24.886783 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-8670d5f4-ad7a-4185-8648-8abc4d4bcb10 req-8d04195c-3c85-4174-b6e4-5e599e276889 service nova] Creating event network-changed:07da3b5f-f66e-485e-8d5c-51d2fe563c69 for instance 27093fe9-e428-4e9d-b997-dc252de8ae3d on hv-cinder-83608 Aug 10 22:55:24.891649 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-8670d5f4-ad7a-4185-8648-8abc4d4bcb10 req-8d04195c-3c85-4174-b6e4-5e599e276889 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099903 Aug 10 22:55:24.892307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 472/954] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:25.663704 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:25.664285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:25.671142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:25.671627 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:25.672065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:25.672752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:25.673203 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:25.673654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:25.728918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:25.729683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:25.736064 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:25.736541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:25.736976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:25.737695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:25.738141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:25.738564 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:25.738711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:25.846474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:25.856308 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:25.857825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:25.859136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-93321b03-d37b-4dce-b11a-5e9a5ccb4eb7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.199360 Aug 10 22:55:25.859691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 483/955] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:25 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:25.905680 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:25.913085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ec300ae0-40f7-4fd1-aef1-32f9be59ebf6 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.189349 Aug 10 22:55:25.913717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 473/956] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:25 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:26.881744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:26.882360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:26.888946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:26.889476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:26.889918 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:26.890616 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:26.891073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:26.891498 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:26.935015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:26.935639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:26.942259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:26.942791 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:26.943235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:26.943947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:26.944577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:26.945027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:27.075473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:27.083973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:27.085732 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:27.086815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4e2d61ec-7cea-431d-b9af-387e668bf01d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.208869 Aug 10 22:55:27.101305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 484/957] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:26 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:55:27.106190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:27.115056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c24af6f3-1828-4c0b-91fa-8fdfd1c4ffd9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.184073 Aug 10 22:55:27.115868 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 474/958] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:26 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:27.271245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-0cafc058-421a-44a4-bbe6-58b41a47ae4c req-3dd3da56-9940-4af2-be30-54c874bc9ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1bb3-65ab-404d-b358-0b580e3559d9", "name": "network-vif-plugged", "status": "completed", "tag": "cee28bdd-1335-44c1-9da4-99dfff6ebedf"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:27.280856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-0cafc058-421a-44a4-bbe6-58b41a47ae4c req-3dd3da56-9940-4af2-be30-54c874bc9ab6 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:27.281369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-0cafc058-421a-44a4-bbe6-58b41a47ae4c req-3dd3da56-9940-4af2-be30-54c874bc9ab6 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:27.281834 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-0cafc058-421a-44a4-bbe6-58b41a47ae4c req-3dd3da56-9940-4af2-be30-54c874bc9ab6 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:27.293475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-0cafc058-421a-44a4-bbe6-58b41a47ae4c req-3dd3da56-9940-4af2-be30-54c874bc9ab6 service nova] Creating event network-vif-plugged:cee28bdd-1335-44c1-9da4-99dfff6ebedf for instance 063e1bb3-65ab-404d-b358-0b580e3559d9 on hv-cinder-83608 Aug 10 22:55:27.298582 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-0cafc058-421a-44a4-bbe6-58b41a47ae4c req-3dd3da56-9940-4af2-be30-54c874bc9ab6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Aug 10 22:55:27.299183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 485/959] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:28.111117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.111761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:28.118234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.118729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.119428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.120187 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.120643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.121069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.136855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.137566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:28.143985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.144468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.144905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.145992 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.146493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.146917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.386517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:28.395032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:28.396801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:28.398022 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-906d462a-9816-48fb-a5b0-f855381c24ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.290909 Aug 10 22:55:28.398619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 475/960] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:28.438399 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:28.446441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f02187c3-f4ae-491e-bf3f-3a3525202370 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.313689 Aug 10 22:55:28.448144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 486/961] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:29.422140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:29.422816 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:29.430371 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:29.431029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:29.431594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:29.432387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:29.432986 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:29.433877 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:29.468577 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:29.469259 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:29.475996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:29.476513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:29.476954 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:29.477698 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:29.478256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:29.478256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:29.629934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:29.638557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:29.640054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:29.641190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-67408572-fe4c-4bfe-b10c-ca11900d8b71 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1406 microversion: 2.20 time: 0.223942 Aug 10 22:55:29.641789 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 476/962] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:29 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:29.653834 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:29.661565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ce89b0f2-5e56-4efb-958a-4e5fcd1ed934 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.196644 Aug 10 22:55:29.662019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 487/963] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:29 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:30.663638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.664284 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:30.671341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.671836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.672279 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.672979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.673476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.673907 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.682883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.683728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:30.690096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.690557 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.690996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.691691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.692141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.692559 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.696853 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:30.813753 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:30.836536 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=12 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:30.882243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:30.890193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:30.891679 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:30.892873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-32437b3e-f939-4f4a-bd6b-8aa6d320fe5a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1598 microversion: 2.20 time: 0.233159 Aug 10 22:55:30.893450 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 477/964] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1598 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:30.899684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:30.907494 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-796b5013-cf52-4a80-9209-1a0484f7e799 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.229043 Aug 10 22:55:30.908053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 488/965] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:30.915171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.915605 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:30.921995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.922475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.922918 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.923598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.924045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.924463 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.928192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=100 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:31.015378 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b5d8c7db-fc67-4bf1-8a2d-9909149cca39 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103991 Aug 10 22:55:31.016011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 478/966] 10.222.0.76 () {60 vars in 1316 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:31.929119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.929983 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:31.931754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=12 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:31.937546 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:31.938035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:31.938474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:31.939184 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:31.939633 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:31.940050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:32.161084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:32.169761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b87fc78b-46d1-427c-8fc6-d1660e02e73e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.244408 Aug 10 22:55:32.170828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 489/967] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:31 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:32.312716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-82a8546c-b415-42e4-afa6-e847c045b1a7 req-ad4a345d-d26e-4a85-a7b3-1fb099ba08c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063e1bb3-65ab-404d-b358-0b580e3559d9", "tag": "cee28bdd-1335-44c1-9da4-99dfff6ebedf"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.322138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-82a8546c-b415-42e4-afa6-e847c045b1a7 req-ad4a345d-d26e-4a85-a7b3-1fb099ba08c5 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:32.323181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-82a8546c-b415-42e4-afa6-e847c045b1a7 req-ad4a345d-d26e-4a85-a7b3-1fb099ba08c5 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:32.323992 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-82a8546c-b415-42e4-afa6-e847c045b1a7 req-ad4a345d-d26e-4a85-a7b3-1fb099ba08c5 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:32.335810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-82a8546c-b415-42e4-afa6-e847c045b1a7 req-ad4a345d-d26e-4a85-a7b3-1fb099ba08c5 service nova] Creating event network-changed:cee28bdd-1335-44c1-9da4-99dfff6ebedf for instance 063e1bb3-65ab-404d-b358-0b580e3559d9 on hv-cinder-83608 Aug 10 22:55:32.342068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-82a8546c-b415-42e4-afa6-e847c045b1a7 req-ad4a345d-d26e-4a85-a7b3-1fb099ba08c5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034555 Aug 10 22:55:32.343149 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 479/968] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:33.192383 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:33.192911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:33.199858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:33.200338 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:33.200770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:33.201489 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:33.201946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:33.202364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:33.327331 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-15c0f005-8d88-4e46-a16b-7772eeaa1bcb req-5b21116e-0f38-4d98-85c9-1b0dcadbc1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27093fe9-e428-4e9d-b997-dc252de8ae3d", "name": "network-vif-plugged", "status": "completed", "tag": "07da3b5f-f66e-485e-8d5c-51d2fe563c69"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:33.341419 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-15c0f005-8d88-4e46-a16b-7772eeaa1bcb req-5b21116e-0f38-4d98-85c9-1b0dcadbc1a3 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:33.343638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-15c0f005-8d88-4e46-a16b-7772eeaa1bcb req-5b21116e-0f38-4d98-85c9-1b0dcadbc1a3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:33.344393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-15c0f005-8d88-4e46-a16b-7772eeaa1bcb req-5b21116e-0f38-4d98-85c9-1b0dcadbc1a3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:33.349019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:33.358353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e7a9dca2-d80d-4d12-b216-2a204670a040 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.169811 Aug 10 22:55:33.359703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 490/969] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:33 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:33.367180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-15c0f005-8d88-4e46-a16b-7772eeaa1bcb req-5b21116e-0f38-4d98-85c9-1b0dcadbc1a3 service nova] Creating event network-vif-plugged:07da3b5f-f66e-485e-8d5c-51d2fe563c69 for instance 27093fe9-e428-4e9d-b997-dc252de8ae3d on hv-cinder-83608 Aug 10 22:55:33.375418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-15c0f005-8d88-4e46-a16b-7772eeaa1bcb req-5b21116e-0f38-4d98-85c9-1b0dcadbc1a3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053522 Aug 10 22:55:33.376255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 480/970] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:34.379966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.380642 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:34.387828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:34.388313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:34.388751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:34.389475 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:34.389931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:34.390361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:34.521172 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:34.528524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-967fdb4d-e59b-4d1e-b170-b36d7bfb92c3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.152470 Aug 10 22:55:34.529075 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 491/971] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:35.550921 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:35.551607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:35.557691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:35.558189 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:35.558602 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:35.559442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:35.560166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:35.560594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:35.698167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:35.706596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bbb88764-e6b5-4724-9035-92195ff263c0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1367 microversion: 2.1 time: 0.160312 Aug 10 22:55:35.707213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 481/972] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:35 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:36.728636 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:36.729161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:36.736343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:36.736781 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:36.737215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:36.737977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:36.738394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:36.738816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:36.874288 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:36.884102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1231de41-6be0-4785-b870-8a630022fa48 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1556 microversion: 2.1 time: 0.159398 Aug 10 22:55:36.884670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 492/973] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:36 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:36.905496 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:36.906070 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:36.912483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:36.912961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:36.913464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:36.914206 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:36.914688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:36.915104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:36.992806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fbc552a0-95d5-412a-a844-0044cd631d82 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091815 Aug 10 22:55:36.993410 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 482/974] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:55:36 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:37.946520 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-5db630fc-cc81-46bf-b591-4ba1b1d347d3 req-7f5b31b0-4d56-47ec-a800-5dea07f4f600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27093fe9-e428-4e9d-b997-dc252de8ae3d", "tag": "07da3b5f-f66e-485e-8d5c-51d2fe563c69"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:37.956684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5db630fc-cc81-46bf-b591-4ba1b1d347d3 req-7f5b31b0-4d56-47ec-a800-5dea07f4f600 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:37.957211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5db630fc-cc81-46bf-b591-4ba1b1d347d3 req-7f5b31b0-4d56-47ec-a800-5dea07f4f600 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:37.957671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5db630fc-cc81-46bf-b591-4ba1b1d347d3 req-7f5b31b0-4d56-47ec-a800-5dea07f4f600 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:37.968824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-5db630fc-cc81-46bf-b591-4ba1b1d347d3 req-7f5b31b0-4d56-47ec-a800-5dea07f4f600 service nova] Creating event network-changed:07da3b5f-f66e-485e-8d5c-51d2fe563c69 for instance 27093fe9-e428-4e9d-b997-dc252de8ae3d on hv-cinder-83608 Aug 10 22:55:37.973833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-5db630fc-cc81-46bf-b591-4ba1b1d347d3 req-7f5b31b0-4d56-47ec-a800-5dea07f4f600 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030928 Aug 10 22:55:37.974437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 493/975] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:40.000693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:40.001342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:40.007288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:40.007777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.008213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.008909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:40.009400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.009832 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.033368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lazy-loading 'flavor' on Instance uuid de1c87dd-de83-4565-bada-4f95a28b7f3b {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:55:40.107835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e9a30d8c-4d3a-44a1-826e-eb4333fcc0dd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "POST /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b/action" status: 202 len: 0 microversion: 2.1 time: 0.112219 Aug 10 22:55:40.108444 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 483/976] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:55:39 2022] POST /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:40.118172 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:40.118848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:40.125931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:40.126389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.126822 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.127514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:40.127961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.128378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.264386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:40.272352 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6d7968c0-ef71-4978-a1a6-2c3423a5dfcc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.159182 Aug 10 22:55:40.272921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 494/977] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:40 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:41.295689 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:41.296305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:41.302457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.302951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.303393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.304107 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.304557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.304988 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.677749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:41.685802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9dc64675-b217-4f4e-bc73-31321ecbba44 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.395226 Aug 10 22:55:41.686360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 484/978] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:41 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:42.707330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:42.707946 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:42.714656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:42.715147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:42.715605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:42.716292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:42.716752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:42.717294 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:42.852639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:42.860445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2d0385c4-2e2c-40f4-9635-2c0660783a8c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.157004 Aug 10 22:55:42.860986 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 495/979] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:42 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:43.882430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:43.883046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:43.889946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:43.890434 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:43.890863 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:43.891545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:43.892000 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:43.892417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:44.027525 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:44.035018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d83370a3-d9bf-408c-ab7f-d3b87ad5ba70 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.156602 Aug 10 22:55:44.035618 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 485/980] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:43 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:45.056128 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:45.056721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:45.063302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:45.063784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:45.064218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:45.064903 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:45.065380 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:45.065805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:45.201639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:45.209768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-970175e9-16cd-4e8b-b352-bd8fb413aaca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.157393 Aug 10 22:55:45.210354 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 496/981] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:45 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:46.232582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:46.233229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:46.240394 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:46.240912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:46.241412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:46.242140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:46.242594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:46.243079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:46.376196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:46.384689 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0c5cb73e-cdb9-4b8f-a94b-63ba6be02cae tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.156041 Aug 10 22:55:46.385259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 486/982] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:46 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:47.406547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:47.407193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:47.410635 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=48 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:47.415973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:47.416465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:47.416910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:47.417643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:47.418102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:47.418529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:47.557643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:47.565048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c2504dbe-bac7-4412-bc92-71fba013cf52 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.162387 Aug 10 22:55:47.565638 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 497/983] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:47 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:48.585896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:48.586503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:48.588887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:48.594169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.594658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.595100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.595800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.596257 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.596682 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.730122 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:48.738678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-95e38716-728a-4aeb-add1-db4d4feb26a9 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.156624 Aug 10 22:55:48.739257 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 487/984] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:48 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:49.761214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:49.761799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:49.768999 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:49.769517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:49.769951 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:49.770637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:49.771097 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:49.771519 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:49.906164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:49.914127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-29fe7567-7383-4e28-85f1-040d300833ac tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.156915 Aug 10 22:55:49.914689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 498/985] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:49 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:50.935437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:50.936038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:50.946225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:50.947538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:50.947972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:50.948672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:50.949118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:50.949572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:51.081135 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:51.088733 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-390095c6-bcbc-4857-853a-765b965bbbfd tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.157117 Aug 10 22:55:51.089332 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 488/986] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:50 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:52.109778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:52.110394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:52.116817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:52.117326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:52.117770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:52.118461 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:52.118917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:52.119340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:52.256912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:52.264688 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-54ff7a8a-879f-4a74-888c-ba3b71761caf tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.158768 Aug 10 22:55:52.265250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 499/987] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:52 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:53.287153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:53.287771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:53.294308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:53.294797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:53.295239 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:53.295943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:53.296401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:53.296831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:53.431845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:53.438799 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bb2f0ad7-5055-408d-9c7c-db77642ea15f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.155869 Aug 10 22:55:53.439612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 489/988] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:53 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:54.461159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:54.461810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:54.468215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:54.468696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:54.469132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:54.469837 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:54.470291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:54.470708 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:54.602784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:54.610242 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0954438e-53d8-4fb4-925f-0b9e06fde31f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.152912 Aug 10 22:55:54.611551 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 500/989] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:54 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:55.624711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1858859078"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:55.627706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:55.632347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:55.632922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:55.633434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:55.633899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:55.634102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:55.634352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:55.634879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:55.635392 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:55.640064 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:55.640555 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:55.640995 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:55.641748 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:55.642645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:55.642779 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:55.911370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.network.security_group_api [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Removing security group c73afaaa-5432-4dec-bfcf-eb959519445e from port 474d9c74-6ea7-4b7f-baf3-afc458023ff1 Aug 10 22:55:55.916838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:55.925121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d2e75e3c-1a6c-4408-98bb-ccd9ca238e3f tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.296317 Aug 10 22:55:55.925742 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 501/990] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:55 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:56.386454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d1c5921f-ab40-4e5b-ba31-360844b17c77 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/action" status: 202 len: 0 microversion: 2.1 time: 0.925505 Aug 10 22:55:56.398066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-ecf94c5a-c04b-4f86-9322-71881fa79d0e req-124e33d4-b351-4caf-8c9c-58d27b2abd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76249cfc-607a-42b8-b469-f9ece621ff37", "tag": "474d9c74-6ea7-4b7f-baf3-afc458023ff1"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:56.398839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 490/991] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:55:55 2022] POST /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/action => generated 0 bytes in 938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:56.408652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-ecf94c5a-c04b-4f86-9322-71881fa79d0e req-124e33d4-b351-4caf-8c9c-58d27b2abd70 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.409134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-ecf94c5a-c04b-4f86-9322-71881fa79d0e req-124e33d4-b351-4caf-8c9c-58d27b2abd70 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.410406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-ecf94c5a-c04b-4f86-9322-71881fa79d0e req-124e33d4-b351-4caf-8c9c-58d27b2abd70 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.434589 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-ecf94c5a-c04b-4f86-9322-71881fa79d0e req-124e33d4-b351-4caf-8c9c-58d27b2abd70 service nova] Creating event network-changed:474d9c74-6ea7-4b7f-baf3-afc458023ff1 for instance 76249cfc-607a-42b8-b469-f9ece621ff37 on hv-cinder-83608 Aug 10 22:55:56.441886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-ecf94c5a-c04b-4f86-9322-71881fa79d0e req-124e33d4-b351-4caf-8c9c-58d27b2abd70 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047466 Aug 10 22:55:56.443411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 502/992] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:56.947518 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:56.948111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:56.954478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.955557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.956005 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.956734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.957192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.957645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:57.200361 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:57.207910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7b69835f-53c5-4c5d-9ef2-69179123d79a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.265504 Aug 10 22:55:57.208498 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 491/993] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:56 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:57.503787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:57.504393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:57.510623 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:57.511110 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:57.511543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:57.512241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:57.512703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:57.513392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:57.595659 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lazy-loading 'services' on Instance uuid 76249cfc-607a-42b8-b469-f9ece621ff37 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:55:57.669053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ea2ded84-4db0-436f-9c9c-798493f407e0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "DELETE /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments/eb164cc4-f564-434d-a0a5-a2b152e5265a" status: 202 len: 0 microversion: 2.1 time: 0.169989 Aug 10 22:55:57.670258 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 503/994] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:55:57 2022] DELETE /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments/eb164cc4-f564-434d-a0a5-a2b152e5265a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:57.679547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:57.681975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:57.690330 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:57.690904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:57.691264 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:57.691962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:57.692461 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:57.692911 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:57.724782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c91085c2-da51-456e-8a51-8d211535e6bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Aug 10 22:55:57.725520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 492/995] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:57 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:58.230095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:58.230791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:58.238038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:58.238535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:58.238999 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:58.239697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:58.240145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:58.240564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:58.380119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:58.388056 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b48cdf5a-8183-4ded-a1ea-588d112eff0b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.162041 Aug 10 22:55:58.388886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 504/996] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:58 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:58.462628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-8a7a04d4-c806-40d4-b0b7-010c1caa2aae req-ab4551e9-fd8f-4a5e-9f84-4f3361f71ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76249cfc-607a-42b8-b469-f9ece621ff37", "tag": "474d9c74-6ea7-4b7f-baf3-afc458023ff1"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:58.473867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8a7a04d4-c806-40d4-b0b7-010c1caa2aae req-ab4551e9-fd8f-4a5e-9f84-4f3361f71ebe service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:58.474398 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8a7a04d4-c806-40d4-b0b7-010c1caa2aae req-ab4551e9-fd8f-4a5e-9f84-4f3361f71ebe service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:58.475029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8a7a04d4-c806-40d4-b0b7-010c1caa2aae req-ab4551e9-fd8f-4a5e-9f84-4f3361f71ebe service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:58.494761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-8a7a04d4-c806-40d4-b0b7-010c1caa2aae req-ab4551e9-fd8f-4a5e-9f84-4f3361f71ebe service nova] Creating event network-changed:474d9c74-6ea7-4b7f-baf3-afc458023ff1 for instance 76249cfc-607a-42b8-b469-f9ece621ff37 on hv-cinder-83608 Aug 10 22:55:58.500207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-8a7a04d4-c806-40d4-b0b7-010c1caa2aae req-ab4551e9-fd8f-4a5e-9f84-4f3361f71ebe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041237 Aug 10 22:55:58.502399 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 493/997] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:58.737939 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:58.741584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:58.749610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:58.750099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:58.750527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:58.751443 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:58.752218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:58.753003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:58.770284 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:58.784459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-97a902bd-7006-4f6a-8013-c0a7697e2ec6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050938 Aug 10 22:55:58.785032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 505/998] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:58 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:59.411232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:59.412335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:59.419368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.419947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.420749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.421867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.422398 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.422951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.651816 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:59.659975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7c41765f-d46a-4f4c-b9ec-57cc26da1391 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1509 microversion: 2.1 time: 0.253412 Aug 10 22:55:59.660655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 494/999] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:59 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:59.680084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:59.680684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:59.686596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.687084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.687527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.688791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.689448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.689887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.719461 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132540) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 22:55:59.784180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1f5b2450-499e-4223-b46b-26ff28918a46 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "POST /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b/action" status: 202 len: 0 microversion: 2.1 time: 0.107901 Aug 10 22:55:59.787927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 506/1000] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 10 22:55:59 2022] POST /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:55:59.793208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:59.794096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:59.797058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:59.800548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:59.800703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.801596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.802043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.802758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.803214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.803867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.807305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.808014 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.808452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.809159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.809694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.810122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.842314 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bac72e32-6fbd-4e91-8362-f1a363b2a514 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049448 Aug 10 22:55:59.845407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 507/1001] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:55:59 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 22:55:59.853074 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:59.853597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:59.859431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.859917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.861768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.862505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.862972 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.863402 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.946290 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] HTTP exception thrown: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 is not attached to volume eb164cc4-f564-434d-a0a5-a2b152e5265a Aug 10 22:55:59.950864 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:59.954430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Request method failure captured: Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments/eb164cc4-f564-434d-a0a5-a2b152e5265a HTTP/1.1 Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DYm7Qu-DbDLGR0O6jU64DPCkyC9-EMxhe-gH7GFNpCIHtnlFC0kKw8HyEkYxTXSm_3tZM_WHd5PhGCjjiSqcpgWrn0zFD2BVS90KLScZg2she42EJtEnNqb41XHrb9BfA7QPZRlVO1BVZc8s3eeUBgLCKNuh2mC585IQdBb85EEiek Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 0f4c72696c814e6e816fd9240569e0db Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-TestMinimumBasicScenario-40439588 Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:55:59.956793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0f4c72696c814e6e816fd9240569e0db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0f4c72696c814e6e816fd9240569e0db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0f4c72696c814e6e816fd9240569e0db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0f4c72696c814e6e816fd9240569e0db"}]}] Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-TestMinimumBasicScenario-40439588 Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 0f4c72696c814e6e816fd9240569e0db Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-TestMinimumBasicScenario-40439588 Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-TestMinimumBasicScenario-40439588-project Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: b9f5b7c7c05c42eda7926cd03a0fd9bc Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-TestMinimumBasicScenario-40439588-project Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:55:59.958618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 is not attached to volume eb164cc4-f564-434d-a0a5-a2b152e5265a Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'server_id': '76249cfc-607a-42b8-b469-f9ece621ff37', 'id': 'eb164cc4-f564-434d-a0a5-a2b152e5265a'} Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eb164cc4-f564-434d-a0a5-a2b152e5265a. Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:59.959486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 is not attached to volume eb164cc4-f564-434d-a0a5-a2b152e5265a Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 is not attached to volume eb164cc4-f564-434d-a0a5-a2b152e5265a Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:55:59.960981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Returning 404 to user: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 is not attached to volume eb164cc4-f564-434d-a0a5-a2b152e5265a {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:59.962247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-803021c3-154c-4ab6-8e8c-9079347b99f0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1517 microversion: 2.1 time: 0.170150 Aug 10 22:55:59.962247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 495/1002] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:59 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:59.962415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-da0fe76d-9c01-473a-b3d7-f279ff17d5c6 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "DELETE /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments/eb164cc4-f564-434d-a0a5-a2b152e5265a" status: 404 len: 154 microversion: 2.1 time: 0.111162 Aug 10 22:55:59.962415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 508/1003] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:55:59 2022] DELETE /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37/os-volume_attachments/eb164cc4-f564-434d-a0a5-a2b152e5265a => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:00.981701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:00.982251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:00.994998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:00.995493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:00.995926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:00.996776 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:00.997225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:00.997673 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.113548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:01.114164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:01.121409 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:01.121978 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:01.122531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.123467 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:01.123932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:01.124442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.140685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:01.150093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-399e4f18-6d73-49c4-83dd-0e567cbbc462 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1519 microversion: 2.1 time: 0.173328 Aug 10 22:56:01.151667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 496/1004] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:00 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:01.162052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:01.245703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f5aef03c-568d-4579-ad97-f32a41c9b7dc tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "DELETE /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 204 len: 0 microversion: 2.1 time: 0.137301 Aug 10 22:56:01.246764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 509/1005] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:01 2022] DELETE /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:56:01.257329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:01.258027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:01.264276 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:01.264760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:01.265307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.266003 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:01.267783 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:01.268242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.417255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-b9931e6b-4c48-4f88-8f9b-e9517f1ebc84 req-1971c831-b3f8-4d9a-be02-a283545fe99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1c87dd-de83-4565-bada-4f95a28b7f3b", "name": "network-vif-unplugged", "status": "completed", "tag": "14a50685-79f1-4c68-a434-68ccadde1e8f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:01.430898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b9931e6b-4c48-4f88-8f9b-e9517f1ebc84 req-1971c831-b3f8-4d9a-be02-a283545fe99c service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:01.431784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b9931e6b-4c48-4f88-8f9b-e9517f1ebc84 req-1971c831-b3f8-4d9a-be02-a283545fe99c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:01.432608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-b9931e6b-4c48-4f88-8f9b-e9517f1ebc84 req-1971c831-b3f8-4d9a-be02-a283545fe99c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.446490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-b9931e6b-4c48-4f88-8f9b-e9517f1ebc84 req-1971c831-b3f8-4d9a-be02-a283545fe99c service nova] Creating event network-vif-unplugged:14a50685-79f1-4c68-a434-68ccadde1e8f for instance de1c87dd-de83-4565-bada-4f95a28b7f3b on hv-cinder-83608 Aug 10 22:56:01.451802 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-b9931e6b-4c48-4f88-8f9b-e9517f1ebc84 req-1971c831-b3f8-4d9a-be02-a283545fe99c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038857 Aug 10 22:56:01.452705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 510/1006] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:01.659092 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:01.666488 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d8ab4223-2bf3-462e-acac-80f3853f0076 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1553 microversion: 2.1 time: 0.414721 Aug 10 22:56:01.667056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 497/1007] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:01 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1553 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:02.174502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:02.175193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:02.181273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:02.181789 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:02.182224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:02.182912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:02.183368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:02.183794 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:02.315393 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:02.322872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8fb15b4a-77aa-47e7-8290-dbb819da8c76 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.153645 Aug 10 22:56:02.323439 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 511/1008] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:02 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:02.687093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:02.687649 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:02.694582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:02.695070 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:02.695503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:02.696206 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:02.696862 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:02.697478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:02.835531 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:02.842951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f8817301-ab4f-4069-8435-251123f42634 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1553 microversion: 2.1 time: 0.159827 Aug 10 22:56:02.843515 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 498/1009] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:02 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:03.343487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:03.344617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:03.352089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.352580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.353023 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.353759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.354221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.354650 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.499013 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:03.508097 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b3049ea3-f0af-4f57-8aeb-aeb250b742ea tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.167396 Aug 10 22:56:03.508097 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 512/1010] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:03 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:03.864402 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:03.865021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:03.871653 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.872842 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.873015 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.873633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.874099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.874524 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.104268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:04.115778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-da65eae5-0ed9-46c5-b62d-686a1963d8bf tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1553 microversion: 2.1 time: 0.255539 Aug 10 22:56:04.116565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 499/1011] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:03 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:04.145534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-7153f2cb-fa9d-4809-a9db-f75e6552ca6a req-4a06e972-198f-4714-bb9e-785abb728051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76249cfc-607a-42b8-b469-f9ece621ff37", "name": "network-vif-deleted", "tag": "474d9c74-6ea7-4b7f-baf3-afc458023ff1"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:04.155678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-7153f2cb-fa9d-4809-a9db-f75e6552ca6a req-4a06e972-198f-4714-bb9e-785abb728051 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.156162 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-7153f2cb-fa9d-4809-a9db-f75e6552ca6a req-4a06e972-198f-4714-bb9e-785abb728051 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.156624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-7153f2cb-fa9d-4809-a9db-f75e6552ca6a req-4a06e972-198f-4714-bb9e-785abb728051 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.168599 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-7153f2cb-fa9d-4809-a9db-f75e6552ca6a req-4a06e972-198f-4714-bb9e-785abb728051 service nova] Creating event network-vif-deleted:474d9c74-6ea7-4b7f-baf3-afc458023ff1 for instance 76249cfc-607a-42b8-b469-f9ece621ff37 on hv-cinder-83608 Aug 10 22:56:04.174209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-7153f2cb-fa9d-4809-a9db-f75e6552ca6a req-4a06e972-198f-4714-bb9e-785abb728051 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034569 Aug 10 22:56:04.175048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 513/1012] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:04.527965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:04.528591 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:04.534989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.535489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.535934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.536651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.537112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.537620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.683201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:04.690975 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-27df831f-da07-4e12-a15e-dd8e6e802d6a tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.166842 Aug 10 22:56:04.691543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 500/1013] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:04 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:05.138770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:05.139520 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:05.147434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.147959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.148516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.149215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.149702 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.150130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.180624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.181104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.181575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.182020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lazy-loading 'fault' on Instance uuid 76249cfc-607a-42b8-b469-f9ece621ff37 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:56:05.224804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f5b7c7c05c42eda7926cd03a0fd9bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4c72696c814e6e816fd9240569e0db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:05.232175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9216cdcf-608d-4f2a-9e00-c9dfc2a7e8f0 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 200 len: 1348 microversion: 2.1 time: 0.098215 Aug 10 22:56:05.232735 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 514/1014] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:05 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:05.711596 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:05.712184 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:05.719405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.720094 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.720554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.721294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.721765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.722200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.901594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:05.913895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-15bc2395-ed21-49b3-8221-910e63c2169c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.206296 Aug 10 22:56:05.914473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 501/1015] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:05 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:05.935388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:05.938438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:05.944709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.945199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.945672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.946381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.946844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.947275 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.986866 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9f7ab517-2738-4e1b-a4f6-ed542b9d2730 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055980 Aug 10 22:56:05.987358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 515/1016] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:56:05 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:06.061067 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:06.061604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:06.071652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.072463 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.073165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.074370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.075885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.076337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.108618 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:06.208066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e3e307af-8a96-432c-afd4-bae61f19f8bf tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 204 len: 0 microversion: 2.1 time: 0.150465 Aug 10 22:56:06.209544 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 502/1017] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:06 2022] DELETE /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:56:06.218652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:06.220539 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:06.230316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.230694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.231139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.232321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.232321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.232706 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.254670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:06.254670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] [instance: 76249cfc-607a-42b8-b469-f9ece621ff37] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:06.261265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.261781 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.262220 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.262925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.263378 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.263797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.282780 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] HTTP exception thrown: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 could not be found. Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Request method failure captured: Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 HTTP/1.1 Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DYm7Qu-DbDLGR0O6jU64DPCkyC9-EMxhe-gH7GFNpCIHtnlFC0kKw8HyEkYxTXSm_3tZM_WHd5PhGCjjiSqcpgWrn0zFD2BVS90KLScZg2she42EJtEnNqb41XHrb9BfA7QPZRlVO1BVZc8s3eeUBgLCKNuh2mC585IQdBb85EEiek Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 0f4c72696c814e6e816fd9240569e0db Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-TestMinimumBasicScenario-40439588 Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:56:06.284430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0f4c72696c814e6e816fd9240569e0db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0f4c72696c814e6e816fd9240569e0db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0f4c72696c814e6e816fd9240569e0db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0f4c72696c814e6e816fd9240569e0db"}]}] Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-TestMinimumBasicScenario-40439588 Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 0f4c72696c814e6e816fd9240569e0db Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-TestMinimumBasicScenario-40439588 Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-TestMinimumBasicScenario-40439588-project Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: b9f5b7c7c05c42eda7926cd03a0fd9bc Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-TestMinimumBasicScenario-40439588-project Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 could not be found. Aug 10 22:56:06.285995 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '76249cfc-607a-42b8-b469-f9ece621ff37'} Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 could not be found. Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:06.286865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 could not be found. Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 could not be found. Aug 10 22:56:06.288309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:06.289741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Returning 404 to user: Instance 76249cfc-607a-42b8-b469-f9ece621ff37 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:06.289741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ab17cdee-f54e-4a72-85c5-a4f3e4f73922 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37" status: 404 len: 111 microversion: 2.1 time: 0.036358 Aug 10 22:56:06.289741 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 503/1018] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:06 2022] GET /compute/v2.1/servers/76249cfc-607a-42b8-b469-f9ece621ff37 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:56:06.296247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-624acf7f-0dff-4d81-ae60-175759928401 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] Calling method '.version_select at 0x7fa9be62daf0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:06.315603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-624acf7f-0dff-4d81-ae60-175759928401 tempest-TestMinimumBasicScenario-40439588 tempest-TestMinimumBasicScenario-40439588-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1739506986" status: 202 len: 0 microversion: 2.1 time: 0.022915 Aug 10 22:56:06.316252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 504/1019] 10.222.0.76 () {58 vars in 1272 bytes} [Wed Aug 10 22:56:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1739506986 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:56:06.388426 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:06.397045 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9c9a31e3-7b0c-428c-9c84-2ae3c139b564 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1672 microversion: 2.1 time: 0.183887 Aug 10 22:56:06.401320 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 516/1020] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:06 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:07.038370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:07.039544 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:07.046514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:07.047151 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:07.047598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:07.048312 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:07.048777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:07.049204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:07.252765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:07.261073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f943fbb6-c807-480d-8dea-bfb77a0c6cb1 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.330494 Aug 10 22:56:07.261681 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 505/1021] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:06 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:07.423894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:07.424625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:07.431368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:07.432666 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:07.432666 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:07.432981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:07.433658 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:07.434093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:07.700346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:07.707803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0bcd2b03-1ac5-4310-ba76-f9feec6cc0f5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1672 microversion: 2.1 time: 0.292376 Aug 10 22:56:07.708372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 517/1022] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:07 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1672 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:08.284861 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:08.285534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:08.292154 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.292650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.293086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.293823 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.294279 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.294699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.657698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:08.665664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fd1ead1a-f9af-4576-89e3-1f386bdc07d4 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.385329 Aug 10 22:56:08.666248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 506/1023] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:08 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:08.730785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:08.731508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:08.739988 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.741268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.742670 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.743398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.744161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.744569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.099250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:09.114440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6d1124f3-490d-4d99-a286-70d73e8cd05f tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1672 microversion: 2.1 time: 0.386636 Aug 10 22:56:09.116285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 518/1024] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:08 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1672 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:09.560619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-087a808f-5eaa-41db-9239-1c3ad9d6f623 req-71ff6eea-fa8e-482f-be73-7a6289239773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b5a255-e068-46e0-8c6d-bdde4a91c933", "name": "network-vif-deleted", "tag": "9c856112-b712-4ce2-941b-5d426ef1738d"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:09.571520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-087a808f-5eaa-41db-9239-1c3ad9d6f623 req-71ff6eea-fa8e-482f-be73-7a6289239773 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.571997 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-087a808f-5eaa-41db-9239-1c3ad9d6f623 req-71ff6eea-fa8e-482f-be73-7a6289239773 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.572417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-087a808f-5eaa-41db-9239-1c3ad9d6f623 req-71ff6eea-fa8e-482f-be73-7a6289239773 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.583867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-087a808f-5eaa-41db-9239-1c3ad9d6f623 req-71ff6eea-fa8e-482f-be73-7a6289239773 service nova] Creating event network-vif-deleted:9c856112-b712-4ce2-941b-5d426ef1738d for instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 on hv-cinder-83608 Aug 10 22:56:09.588736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-087a808f-5eaa-41db-9239-1c3ad9d6f623 req-71ff6eea-fa8e-482f-be73-7a6289239773 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032217 Aug 10 22:56:09.589780 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 507/1025] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:09.694663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.695549 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:09.706838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.708081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.709138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.726998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.729309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.729961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.918035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:09.928232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c01a7a05-b398-47e4-8fc8-f5b756d2fe1c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.243927 Aug 10 22:56:09.929470 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 519/1026] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:10.144093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:10.145180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:10.158440 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:10.160720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:10.161661 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:10.174367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:10.175103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:10.175712 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:10.237272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:10.237793 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:10.238229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:10.238681 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lazy-loading 'fault' on Instance uuid 05b5a255-e068-46e0-8c6d-bdde4a91c933 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:56:10.302809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:10.310173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-56ba628a-d36f-4363-9587-294049552531 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 200 len: 1326 microversion: 2.1 time: 0.171835 Aug 10 22:56:10.310759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 508/1027] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:10 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 1326 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:10.954506 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:10.955059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:10.961472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:10.961956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:10.962390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:10.963076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:10.963524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:10.963944 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:10.982356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:11.125587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:11.133886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-16026554-a9ac-4f42-aaec-14dd0105ced5 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.184379 Aug 10 22:56:11.147626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 520/1028] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:10 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:11.331338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:11.331902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:11.342004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:11.349739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:11.350325 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:11.351244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:11.351976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:11.352500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:11.368241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] HTTP exception thrown: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Request method failure captured: Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 HTTP/1.1 Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWPbIZ58ND2bkv800UNUztf5RgwLh80MlKXOHpbEvybC__KZ6lN3sHhlT6-W4e_74I2e0O0f6tKj4RUkFk6bqcETTfV81jSuO3cxcxOl3URev3VomBq6KLtkFW7oZIRmoeLEMJPwa1aiZOHyAv2qOwySrUhdogngz8_JfMfHV_kkjE Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:56:11.370798 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}] Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 405738ed219b4fdc8e3c07706a13e5a2 Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:56:11.372099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '05b5a255-e068-46e0-8c6d-bdde4a91c933'} Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:11.372846 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:56:11.374066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:11.377759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Returning 404 to user: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:11.379210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-37081160-2ec3-4250-8bcd-90f3554e2be5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 404 len: 111 microversion: 2.1 time: 0.052015 Aug 10 22:56:11.380305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 509/1029] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:11 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:11.389016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6a9bcc8b-2f5e-405b-b922-07216a4abcee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '.version_select at 0x7fa9be794f70>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:11.423514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6a9bcc8b-2f5e-405b-b922-07216a4abcee tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643217114" status: 202 len: 0 microversion: 2.1 time: 0.038727 Aug 10 22:56:11.428158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 521/1030] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 10 22:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643217114 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:56:12.159188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.159803 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:12.165746 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.166232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.166667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.167368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.167824 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.168253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.476225 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6c025e44-8bd5-4ad6-a883-5ac5ca4275f1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'create', calling method: .version_select at 0x7fa9be6acca0>, body: {"keypair": {"name": "tempest-keypair-2123804039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJuZTmiaZLyvH5RmPx/yI+cBiK3ivPd1W8Nl0rnAeTrziTu5kjRmrndZQDIN02vXOVouduimERnfZG2NmsgIW2r6I7WqZaK58ZjhF+ObE1dPx0MNZscDsFaLKKludAdSA=="}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:12.492009 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-6c025e44-8bd5-4ad6-a883-5ac5ca4275f1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for project b81a25303ced4ea4bf5351ec42192c13. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:12.495912 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-6c025e44-8bd5-4ad6-a883-5ac5ca4275f1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for user 405738ed219b4fdc8e3c07706a13e5a2 and project b81a25303ced4ea4bf5351ec42192c13. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:12.500470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:12.510813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-223e1d55-85df-4aba-87c7-2a715cd50dca tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.355202 Aug 10 22:56:12.511848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 510/1031] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:12 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:12.527743 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6c025e44-8bd5-4ad6-a883-5ac5ca4275f1 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055884 Aug 10 22:56:12.528357 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 522/1032] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:56:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:13.534109 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:13.535325 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:13.541945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.542692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.543305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.544019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.544637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.546202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.771223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:13.779033 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-89c951a8-2d04-41b2-9e3d-01613a4698bc tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.249441 Aug 10 22:56:13.779721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 511/1033] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:13 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:13.982830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-616686494", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3c018dd-0e2f-4505-af82-5b32938180f6"}], "security_groups": [{"name": "tempest-securitygroup--1448535282"}], "key_name": "tempest-keypair-2123804039", "user_data": "}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:14.107164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] validate_networks() for [('e3c018dd-0e2f-4505-af82-5b32938180f6', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:14.537881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:14.538415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:14.539374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:14.539862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:14.540353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:14.550547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.551150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.551661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.552468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.553001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.553750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.573703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for project b81a25303ced4ea4bf5351ec42192c13. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:14.578956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Getting quotas for user 405738ed219b4fdc8e3c07706a13e5a2 and project b81a25303ced4ea4bf5351ec42192c13. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:14.590514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:56:14.593453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:56:14.644203 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-52412a38-1350-490f-8bec-7cf060b7f9b7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666533 Aug 10 22:56:14.645819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 523/1034] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:56:14.659643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a28d7036-bc85-49d3-9df7-d921cefbcfa3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:14.662482 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a28d7036-bc85-49d3-9df7-d921cefbcfa3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:14.752859 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a28d7036-bc85-49d3-9df7-d921cefbcfa3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:14.760285 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a28d7036-bc85-49d3-9df7-d921cefbcfa3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1237 microversion: 2.1 time: 0.107320 Aug 10 22:56:14.761360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 512/1035] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:14 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:14.800097 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:14.800743 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:14.809297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.809803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.810241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.810942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.811394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.811868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.962750 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:14.974007 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c9adb191-f2e4-4bf3-a51e-0b2d00487547 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.177566 Aug 10 22:56:14.974571 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 524/1036] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:14 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:15.782039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.782556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:15.797197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:15.797739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:15.801965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.802928 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:15.803570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:15.804871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.889903 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-9635c41b-8827-4680-a9f6-4f17e10a77df req-1b89308a-079e-4e6c-9798-9e589521d398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1c87dd-de83-4565-bada-4f95a28b7f3b", "name": "network-vif-plugged", "status": "completed", "tag": "14a50685-79f1-4c68-a434-68ccadde1e8f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:15.909095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-9635c41b-8827-4680-a9f6-4f17e10a77df req-1b89308a-079e-4e6c-9798-9e589521d398 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:15.909815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-9635c41b-8827-4680-a9f6-4f17e10a77df req-1b89308a-079e-4e6c-9798-9e589521d398 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:15.910536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-9635c41b-8827-4680-a9f6-4f17e10a77df req-1b89308a-079e-4e6c-9798-9e589521d398 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.943979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-9635c41b-8827-4680-a9f6-4f17e10a77df req-1b89308a-079e-4e6c-9798-9e589521d398 service nova] Creating event network-vif-plugged:14a50685-79f1-4c68-a434-68ccadde1e8f for instance de1c87dd-de83-4565-bada-4f95a28b7f3b on hv-cinder-83608 Aug 10 22:56:15.955963 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-9635c41b-8827-4680-a9f6-4f17e10a77df req-1b89308a-079e-4e6c-9798-9e589521d398 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072390 Aug 10 22:56:15.976342 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 525/1037] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:15.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:16.000540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:16.010523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:16.028881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.031715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.032394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:16.032523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:16.033529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.034168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.034762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:16.055352 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-dd9bcc0e-2633-4bfa-89d8-bf5e715deaba tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1297 microversion: 2.1 time: 0.269524 Aug 10 22:56:16.058105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 513/1038] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:15 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1297 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:16.269634 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:16.277625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-74c86e87-3386-4337-b4a6-c091ff0b3977 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.282581 Aug 10 22:56:16.278385 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 526/1039] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:15 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:17.082446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:17.083172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:17.097966 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.100632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.101219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.106924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.107477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.108040 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.158307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:17.299539 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:17.300087 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:17.306457 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.306964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.307396 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.308086 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.308535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.308955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.389805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:17.397983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4b0d7159-827c-43f2-ad92-8733493d8d03 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.320670 Aug 10 22:56:17.398554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 514/1040] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:17 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:17.594913 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:17.602484 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-034572d5-60fa-4231-be98-19208c69c62c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.307503 Aug 10 22:56:17.603064 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 527/1041] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:17 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:17.976950 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-0f8cb8e5-45df-4ace-befc-d6d94adb16a3 req-49e6c3b0-d1e8-4cd1-9345-e0e8f1ae081b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7f5fd2-0282-44a3-a894-fb4dd80b25d4", "tag": "8e83b98a-05cd-4c91-b4b7-7f881834cbfa"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:17.989328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-0f8cb8e5-45df-4ace-befc-d6d94adb16a3 req-49e6c3b0-d1e8-4cd1-9345-e0e8f1ae081b service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.990110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-0f8cb8e5-45df-4ace-befc-d6d94adb16a3 req-49e6c3b0-d1e8-4cd1-9345-e0e8f1ae081b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.990546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-0f8cb8e5-45df-4ace-befc-d6d94adb16a3 req-49e6c3b0-d1e8-4cd1-9345-e0e8f1ae081b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.002334 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-0f8cb8e5-45df-4ace-befc-d6d94adb16a3 req-49e6c3b0-d1e8-4cd1-9345-e0e8f1ae081b service nova] Creating event network-changed:8e83b98a-05cd-4c91-b4b7-7f881834cbfa for instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 on hv-cinder-83608 Aug 10 22:56:18.007255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-0f8cb8e5-45df-4ace-befc-d6d94adb16a3 req-49e6c3b0-d1e8-4cd1-9345-e0e8f1ae081b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Aug 10 22:56:18.007852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 515/1042] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:18.419580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.420110 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:18.426865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:18.427350 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:18.427804 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.428492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:18.428949 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:18.429400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.569849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:18.577674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c1839538-556e-42dc-b469-935b7cd748f6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.161839 Aug 10 22:56:18.578234 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 528/1043] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:18 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:18.626332 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.627055 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:18.628990 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:18.634442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:18.634935 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:18.635373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.636069 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:18.636542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:18.636945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.809151 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:18.818356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0f16e0c9-4bd4-4bb2-b124-c17ea2042fdb tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1575 microversion: 2.1 time: 0.197607 Aug 10 22:56:18.819795 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 516/1044] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:18 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:19.598991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:19.599624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:19.606080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:19.606559 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:19.606990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:19.607675 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:19.608144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:19.608564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:19.737369 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:19.744644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1e9f98d6-98dd-4864-9cbd-62d532e3a3b5 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.149559 Aug 10 22:56:19.745201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 529/1045] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:19 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:19.840805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:19.841446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:19.848125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:19.848614 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:19.849050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:19.849779 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:19.850234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:19.850658 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:19.983175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:19.990964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5c1e351a-1072-4576-a863-74acd147dfc8 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1562 microversion: 2.1 time: 0.154037 Aug 10 22:56:19.991529 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 517/1046] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:19 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:20.767465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:20.768015 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:20.774418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:20.774909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:20.775355 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:20.776057 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:20.776526 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:20.776956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:20.906405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:20.913840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-545c1cd6-e9e8-44d0-a1e7-9414bfc6e834 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.151487 Aug 10 22:56:20.914408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 530/1047] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:20 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:21.934848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:21.935455 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:21.942142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:21.942633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:21.943068 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:21.943769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:21.944216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:21.944634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.166711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:22.175478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1f41a91f-e211-490a-b31a-941a7a1c0795 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.244468 Aug 10 22:56:22.176062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 518/1048] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:21 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:23.197400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:23.198035 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:23.205067 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.205564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.206000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.206683 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.207130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.207547 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.345375 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:23.352712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d51eab39-c41d-47f8-b834-50f7e87fec20 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.159157 Aug 10 22:56:23.353301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 531/1049] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:23 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:24.373767 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:24.374443 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:24.380343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.380834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.381310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.382006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.382472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.382902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.512638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:24.520954 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8583a715-95a4-4b7b-948d-61eebaf69419 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.151114 Aug 10 22:56:24.521488 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 519/1050] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:24 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:25.542234 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:25.542870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:25.545865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:25.546339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=10 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:25.552571 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.553092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.553570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:25.554271 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.554734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.555177 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:25.690590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:25.698440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-31c9ea79-20d2-4011-88b5-a754f4a3bbad tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.160045 Aug 10 22:56:25.699013 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 532/1051] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:25 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:25.803640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-29d39937-fcaa-4414-bb8f-d603c097f9f0 req-51296c3d-f96b-4243-bfdc-925dc9743d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7f5fd2-0282-44a3-a894-fb4dd80b25d4", "name": "network-vif-plugged", "status": "completed", "tag": "8e83b98a-05cd-4c91-b4b7-7f881834cbfa"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:25.808557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:25.815499 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-29d39937-fcaa-4414-bb8f-d603c097f9f0 req-51296c3d-f96b-4243-bfdc-925dc9743d16 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.815986 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-29d39937-fcaa-4414-bb8f-d603c097f9f0 req-51296c3d-f96b-4243-bfdc-925dc9743d16 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.816416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-29d39937-fcaa-4414-bb8f-d603c097f9f0 req-51296c3d-f96b-4243-bfdc-925dc9743d16 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:25.827841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-29d39937-fcaa-4414-bb8f-d603c097f9f0 req-51296c3d-f96b-4243-bfdc-925dc9743d16 service nova] Creating event network-vif-plugged:8e83b98a-05cd-4c91-b4b7-7f881834cbfa for instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 on hv-cinder-83608 Aug 10 22:56:25.832651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-29d39937-fcaa-4414-bb8f-d603c097f9f0 req-51296c3d-f96b-4243-bfdc-925dc9743d16 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032697 Aug 10 22:56:25.833262 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 520/1052] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:26.719554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:26.720208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:26.727045 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.727539 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.727981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.728683 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.729141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.729607 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.863083 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:26.870465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0f8c04e2-6ccd-4e2d-93b6-001db692fa42 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1363 microversion: 2.1 time: 0.155091 Aug 10 22:56:26.871029 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 533/1053] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:26 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:27.893639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:27.894334 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:27.900406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.900892 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.901356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.902049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.902537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.902962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.032535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:28.039985 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2f8a26ca-b1ef-49b6-9c38-8232999b0ce7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1548 microversion: 2.1 time: 0.151602 Aug 10 22:56:28.040542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 521/1054] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:27 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:28.060652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:28.061312 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:28.067213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.067712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.068188 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.068874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.069347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.069771 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.158762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1114b661-788f-45a7-9827-e1f605685c54 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101907 Aug 10 22:56:28.159355 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 534/1055] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:56:28 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:29.336625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-83ac4b82-3b4d-4401-baa9-8df1c6cc85a2 req-b8c98a77-ab3a-4e18-af6b-4afd597ada24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7f5fd2-0282-44a3-a894-fb4dd80b25d4", "tag": "8e83b98a-05cd-4c91-b4b7-7f881834cbfa"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:29.346545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-83ac4b82-3b4d-4401-baa9-8df1c6cc85a2 req-b8c98a77-ab3a-4e18-af6b-4afd597ada24 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:29.347027 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-83ac4b82-3b4d-4401-baa9-8df1c6cc85a2 req-b8c98a77-ab3a-4e18-af6b-4afd597ada24 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:29.347467 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-83ac4b82-3b4d-4401-baa9-8df1c6cc85a2 req-b8c98a77-ab3a-4e18-af6b-4afd597ada24 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:29.358919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-83ac4b82-3b4d-4401-baa9-8df1c6cc85a2 req-b8c98a77-ab3a-4e18-af6b-4afd597ada24 service nova] Creating event network-changed:8e83b98a-05cd-4c91-b4b7-7f881834cbfa for instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 on hv-cinder-83608 Aug 10 22:56:29.363912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-83ac4b82-3b4d-4401-baa9-8df1c6cc85a2 req-b8c98a77-ab3a-4e18-af6b-4afd597ada24 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030938 Aug 10 22:56:29.364760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 522/1056] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:33.921000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:33.921618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:33.927435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:33.927914 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:33.928347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:33.929031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:33.929522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:33.929945 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.019123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lazy-loading 'services' on Instance uuid d918f389-4e74-4995-91c3-a16be1f17b0b {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:56:34.089909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6d5bfe09-0896-4c9e-892e-f99a611ce3fd tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments/ff3deb6e-3648-43e0-b45b-d6c9896b68d3" status: 202 len: 0 microversion: 2.1 time: 0.173393 Aug 10 22:56:34.090513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 535/1057] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:56:33 2022] DELETE /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments/ff3deb6e-3648-43e0-b45b-d6c9896b68d3 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:56:34.099714 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:34.102000 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:34.109182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.109929 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.110448 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.111243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.111721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.112186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.150209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-993ff2a0-d299-4ca1-9127-ce422d36b746 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054764 Aug 10 22:56:34.150761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 523/1058] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:56:34 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:35.164539 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.166934 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:35.173728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.174214 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.174654 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.175349 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.175806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.176233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.204431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-896a05fc-4b12-4cdc-8ecb-9b51e520fd89 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044681 Aug 10 22:56:35.204990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 536/1059] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:56:35 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:35.287024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.287561 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:35.293999 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.295076 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.295539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.296233 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.296678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.297100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.322035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:35.395498 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0c60d2ea-6a75-4cca-a6f1-377db39464a7 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 204 len: 0 microversion: 2.1 time: 0.112000 Aug 10 22:56:35.396205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 524/1060] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:35 2022] DELETE /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:56:35.404686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.405317 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:35.411316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.411856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.412287 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.413087 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.413569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.413993 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.544617 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:35.552758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-052a3a8d-6ae0-4c6c-bb3f-f7e598e93ae9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1691 microversion: 2.1 time: 0.152426 Aug 10 22:56:35.553330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 537/1061] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:35 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:36.574507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:36.575201 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:36.581708 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.582221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.582663 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.583362 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.583816 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.584244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.720554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:36.727998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4c08fea2-5bdf-4bae-8d67-969294e2ad6f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1691 microversion: 2.1 time: 0.157702 Aug 10 22:56:36.728565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 525/1062] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:36 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:37.750255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:37.750872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:37.757311 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.757785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.758221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.758910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.759362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.759785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.891990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:37.899527 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-958147c2-b06e-410b-8191-3c57e826f339 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1691 microversion: 2.1 time: 0.154170 Aug 10 22:56:37.900100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 538/1063] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:37 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:38.921021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.921656 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:38.928605 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.929140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.929630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:38.930373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.930834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.931263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.066529 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:39.073938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c04f48f6-e000-4c38-8808-095a9055a31f tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1691 microversion: 2.1 time: 0.157463 Aug 10 22:56:39.074507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 526/1064] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:38 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:40.095590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:40.096234 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:40.102792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:40.103278 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:40.103721 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:40.104428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:40.104884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:40.105326 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:40.347751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:40.355210 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-48043515-1b71-4467-abc0-ab2ef3b53d7d tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1691 microversion: 2.1 time: 0.263637 Aug 10 22:56:40.355973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 539/1065] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:40 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1691 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:41.042707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-5c04f7fd-1d7b-4712-8e3c-339f8b56ed62 req-fe1caef0-b38a-4468-bd02-8b9866c59a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d918f389-4e74-4995-91c3-a16be1f17b0b", "name": "network-vif-deleted", "tag": "4e93fd28-7dd8-4ea3-93a6-89f48468b295"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:41.053620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-5c04f7fd-1d7b-4712-8e3c-339f8b56ed62 req-fe1caef0-b38a-4468-bd02-8b9866c59a6f service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:41.054109 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-5c04f7fd-1d7b-4712-8e3c-339f8b56ed62 req-fe1caef0-b38a-4468-bd02-8b9866c59a6f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:41.054760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-5c04f7fd-1d7b-4712-8e3c-339f8b56ed62 req-fe1caef0-b38a-4468-bd02-8b9866c59a6f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.067574 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-5c04f7fd-1d7b-4712-8e3c-339f8b56ed62 req-fe1caef0-b38a-4468-bd02-8b9866c59a6f service nova] Creating event network-vif-deleted:4e93fd28-7dd8-4ea3-93a6-89f48468b295 for instance d918f389-4e74-4995-91c3-a16be1f17b0b on hv-cinder-83608 Aug 10 22:56:41.072761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-5c04f7fd-1d7b-4712-8e3c-339f8b56ed62 req-fe1caef0-b38a-4468-bd02-8b9866c59a6f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033967 Aug 10 22:56:41.073384 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 527/1066] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:41.376310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:41.376878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:41.383247 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:41.383734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:41.384178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.384880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:41.385368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:41.385801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.391277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:41.420404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:41.421270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:41.421833 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.422296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lazy-loading 'fault' on Instance uuid d918f389-4e74-4995-91c3-a16be1f17b0b {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:56:41.473098 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:41.480652 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3887b656-6028-4dd1-b066-6467d8e93d36 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 200 len: 1335 microversion: 2.1 time: 0.108621 Aug 10 22:56:41.481218 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 540/1067] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:41 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:42.502818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:42.503517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: d918f389-4e74-4995-91c3-a16be1f17b0b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:42.509665 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.510146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.510583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.511272 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.511726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.512157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.526202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] HTTP exception thrown: Instance d918f389-4e74-4995-91c3-a16be1f17b0b could not be found. Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Request method failure captured: Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b HTTP/1.1 Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DYCKYlw68MXeAFmR5fqjvgrUqsL0n9nwTLmQ4I0_7dW16ug4hl5z_6m1p5BJHDmMIW15DDQ9G-MLcnqSWMYvvl4Qjz-oHmnyqlwHJ1qwqOfIHNBN67OnMnYgOErpG0KHmKLwItc1eXMIM1qX6-BSzEwE_1d5cTANt1kIG_sbezjXBY Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:56:42.527788 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}] Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 6367371496f04cc2a7c105fbbed68dca Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance d918f389-4e74-4995-91c3-a16be1f17b0b could not be found. Aug 10 22:56:42.529915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': 'd918f389-4e74-4995-91c3-a16be1f17b0b'} Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d918f389-4e74-4995-91c3-a16be1f17b0b could not be found. Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:42.530836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d918f389-4e74-4995-91c3-a16be1f17b0b could not be found. Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d918f389-4e74-4995-91c3-a16be1f17b0b could not be found. Aug 10 22:56:42.532466 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:42.534173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Returning 404 to user: Instance d918f389-4e74-4995-91c3-a16be1f17b0b could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:42.534173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c0f68d86-2d60-4444-99e2-58463749c518 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b" status: 404 len: 111 microversion: 2.1 time: 0.031064 Aug 10 22:56:42.534173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 528/1068] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:42 2022] GET /compute/v2.1/servers/d918f389-4e74-4995-91c3-a16be1f17b0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:42.538431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-020a888b-05f5-4af6-8a64-56fdb14b24be tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '.version_select at 0x7fa9c2e26940>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:42.557172 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-020a888b-05f5-4af6-8a64-56fdb14b24be tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552635695" status: 202 len: 0 microversion: 2.1 time: 0.022609 Aug 10 22:56:42.557771 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 541/1069] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 10 22:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552635695 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:56:45.428860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:45.429408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:45.435872 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:45.436452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:45.436883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:45.437603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:45.438054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:45.438479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:45.464001 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:45.538994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-66825644-b8e1-4d41-95fd-e2ec3d7bdfd0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "DELETE /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 204 len: 0 microversion: 2.1 time: 0.113652 Aug 10 22:56:45.539780 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 529/1070] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:45 2022] DELETE /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:56:45.548531 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:45.549148 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:45.556431 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:45.556918 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:45.557383 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:45.558080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:45.558536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:45.558960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:45.689141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:45.696533 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bb0adc27-128c-4214-b6a1-6192d48cbe16 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1508 microversion: 2.1 time: 0.152735 Aug 10 22:56:45.697111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 542/1071] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:45 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:46.717495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:46.718202 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:46.725235 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:46.725759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:46.726208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:46.726919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:46.727380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:46.727811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:46.864373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:46.873029 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ab3ae81e-c29b-4f56-8a4d-5c01b280e6a9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 200 len: 1508 microversion: 2.1 time: 0.159472 Aug 10 22:56:46.873322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 530/1072] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:46 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:47.145156 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-8b3be9b6-8b9b-4be9-aa9b-80863cfde1ff req-273259b5-6a1d-4c15-be77-73df6d93e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2", "name": "network-vif-deleted", "tag": "fa99d083-4ee8-4451-8b09-65ab49e795b1"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:47.151606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:47.155473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-8b3be9b6-8b9b-4be9-aa9b-80863cfde1ff req-273259b5-6a1d-4c15-be77-73df6d93e4ba service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:47.157100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-8b3be9b6-8b9b-4be9-aa9b-80863cfde1ff req-273259b5-6a1d-4c15-be77-73df6d93e4ba service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:47.157272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-8b3be9b6-8b9b-4be9-aa9b-80863cfde1ff req-273259b5-6a1d-4c15-be77-73df6d93e4ba service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:47.170739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-8b3be9b6-8b9b-4be9-aa9b-80863cfde1ff req-273259b5-6a1d-4c15-be77-73df6d93e4ba service nova] Creating event network-vif-deleted:fa99d083-4ee8-4451-8b09-65ab49e795b1 for instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 on hv-cinder-83608 Aug 10 22:56:47.175836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-8b3be9b6-8b9b-4be9-aa9b-80863cfde1ff req-273259b5-6a1d-4c15-be77-73df6d93e4ba service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035114 Aug 10 22:56:47.176442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 543/1073] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:47.894191 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:47.894805 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:47.901104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:47.901629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:47.902062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:47.902837 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:47.903293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:47.903716 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:47.907879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:47.917712 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] HTTP exception thrown: Instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 could not be found. Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Request method failure captured: Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 HTTP/1.1 Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DYCKYlw68MXeAFmR5fqjvgrUqsL0n9nwTLmQ4I0_7dW16ug4hl5z_6m1p5BJHDmMIW15DDQ9G-MLcnqSWMYvvl4Qjz-oHmnyqlwHJ1qwqOfIHNBN67OnMnYgOErpG0KHmKLwItc1eXMIM1qX6-BSzEwE_1d5cTANt1kIG_sbezjXBY Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:56:47.919408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}] Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 6367371496f04cc2a7c105fbbed68dca Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 could not be found. Aug 10 22:56:47.921105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2'} Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 could not be found. Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:47.922554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 could not be found. Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 could not be found. Aug 10 22:56:47.923831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:56:47.925096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Returning 404 to user: Instance 34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:47.925096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-04602d99-e90b-4515-9648-76f8536db6d0 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2" status: 404 len: 111 microversion: 2.1 time: 0.030455 Aug 10 22:56:47.925096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 531/1074] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:47 2022] GET /compute/v2.1/servers/34cbbada-7ac9-4dc3-94e2-6a7c3fd760d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:47.931071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:47.931658 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:47.939831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:47.940321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:47.940765 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:47.941499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:47.941958 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:47.942388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:47.967888 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:48.053830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3f9852b2-abcb-4ed2-a937-9dce1654b1d1 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "DELETE /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 204 len: 0 microversion: 2.1 time: 0.126491 Aug 10 22:56:48.055810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 544/1075] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:47 2022] DELETE /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:56:48.064987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:48.065763 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:48.073670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.074257 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.074792 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.075583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.076125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.076893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.215130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:48.223385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e30d6b29-2153-4d1e-b0d2-065218718515 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.163702 Aug 10 22:56:48.223971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 532/1076] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:48 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:49.246085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:49.246777 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:49.253823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.254305 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.254737 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.255429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.255876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.256293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.411718 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6367371496f04cc2a7c105fbbed68dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b951d69396403b9f4b88cea1f3fa76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:49.422841 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b7367ba8-ee5b-4c7b-899f-38d8a7cac7f9 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 200 len: 1523 microversion: 2.1 time: 0.180694 Aug 10 22:56:49.424170 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 545/1077] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:49 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:49.476266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-feff5b48-38a8-40cc-a42f-c0918d964d62 req-9525b4dd-c4b1-4001-98f1-9b78176d6b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ebe63a-b81b-4a3e-8ab3-73ccf0173447", "name": "network-vif-deleted", "tag": "14e5811e-4417-40ea-b407-30b590d4a386"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:49.482616 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:49.496138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-feff5b48-38a8-40cc-a42f-c0918d964d62 req-9525b4dd-c4b1-4001-98f1-9b78176d6b37 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.496633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-feff5b48-38a8-40cc-a42f-c0918d964d62 req-9525b4dd-c4b1-4001-98f1-9b78176d6b37 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.497085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-feff5b48-38a8-40cc-a42f-c0918d964d62 req-9525b4dd-c4b1-4001-98f1-9b78176d6b37 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.510761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-feff5b48-38a8-40cc-a42f-c0918d964d62 req-9525b4dd-c4b1-4001-98f1-9b78176d6b37 service nova] Creating event network-vif-deleted:14e5811e-4417-40ea-b407-30b590d4a386 for instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 on hv-cinder-83608 Aug 10 22:56:49.516806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-feff5b48-38a8-40cc-a42f-c0918d964d62 req-9525b4dd-c4b1-4001-98f1-9b78176d6b37 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044186 Aug 10 22:56:49.517749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 533/1078] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:50.451868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:50.452584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] [instance: 26ebe63a-b81b-4a3e-8ab3-73ccf0173447] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:50.459210 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:50.459685 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:50.460117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:50.460806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:50.461254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:50.461697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:50.475186 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] HTTP exception thrown: Instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 could not be found. Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Request method failure captured: Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 HTTP/1.1 Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DYCKYlw68MXeAFmR5fqjvgrUqsL0n9nwTLmQ4I0_7dW16ug4hl5z_6m1p5BJHDmMIW15DDQ9G-MLcnqSWMYvvl4Qjz-oHmnyqlwHJ1qwqOfIHNBN67OnMnYgOErpG0KHmKLwItc1eXMIM1qX6-BSzEwE_1d5cTANt1kIG_sbezjXBY Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:56:50.476800 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_24b951d69396403b9f4b88cea1f3fa76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/24b951d69396403b9f4b88cea1f3fa76"}]}] Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 24b951d69396403b9f4b88cea1f3fa76 Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1712070183 Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 6367371496f04cc2a7c105fbbed68dca Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1712070183-project Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 could not be found. Aug 10 22:56:50.478398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '26ebe63a-b81b-4a3e-8ab3-73ccf0173447'} Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 could not be found. Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:50.479272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 could not be found. Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 could not be found. Aug 10 22:56:50.480770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:56:50.482254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] Returning 404 to user: Instance 26ebe63a-b81b-4a3e-8ab3-73ccf0173447 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:50.482254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0e7f0dcf-2fd7-402c-a0b2-a9344fc29269 tempest-ServerRescueNegativeTestJSON-1712070183 tempest-ServerRescueNegativeTestJSON-1712070183-project] 10.222.0.76 "GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447" status: 404 len: 111 microversion: 2.1 time: 0.030255 Aug 10 22:56:50.482254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 546/1079] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:50 2022] GET /compute/v2.1/servers/26ebe63a-b81b-4a3e-8ab3-73ccf0173447 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:57:02.235648 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=9 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:02.236418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:02.240947 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:02.241565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:02.248895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:02.249921 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:02.250465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:02.251462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:02.252034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:02.252480 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:02.279042 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-79babb64-3b8e-4fbf-8a5a-5034694b47d5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/ips" status: 200 len: 152 microversion: 2.20 time: 0.045389 Aug 10 22:57:02.279613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 534/1080] 10.222.0.76 () {60 vars in 1289 bytes} [Wed Aug 10 22:57:02 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:05.256025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:05.256588 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:05.258966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:05.259615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:05.264678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:05.265898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:05.266425 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:05.267154 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:05.267613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:05.268041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:05.296082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lazy-loading 'flavor' on Instance uuid 063e1bb3-65ab-404d-b358-0b580e3559d9 {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:05.506785 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ca827295-5023-4b8a-9eb1-81418c779c0f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/action" status: 202 len: 0 microversion: 2.20 time: 0.254573 Aug 10 22:57:05.507434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 547/1081] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 10 22:57:05 2022] POST /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:57:05.516775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:05.517512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:05.524139 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:05.524727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:05.525176 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:05.526019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:05.526543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:05.526952 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:05.668883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:05.677744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:05.679252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:05.680407 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7004bd13-6f0b-4e2c-8be1-477d70c55330 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.168755 Aug 10 22:57:05.680961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 535/1082] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:05 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:06.707801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:06.708505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:06.716493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.716987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.717469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:06.719125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.719904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.720460 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:06.875712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:06.885816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:06.887715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:06.890413 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-108a5ec5-5bdf-4fcd-be21-1ff13e2e4c9d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.187884 Aug 10 22:57:06.891298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 548/1083] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:06 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:07.915923 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:07.916539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:07.923612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:07.924102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:07.924721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:07.925465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:07.925926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:07.926356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:08.065729 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:08.073978 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:08.075566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:08.076727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-12357529-81f9-4b2c-b04a-d6119cbffaae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.164667 Aug 10 22:57:08.077546 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 536/1084] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:07 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:09.100354 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:09.100948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:09.107593 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.108706 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.109967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.110062 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.110713 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.111089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.253761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:09.262282 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:09.263844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:09.265196 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7ae022c4-86c4-4282-a4bb-119f0f60b3ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.168558 Aug 10 22:57:09.265873 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 549/1085] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:09 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:10.288169 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:10.288709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:10.295084 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:10.296187 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:10.296561 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:10.297256 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:10.297731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:10.298153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:10.428451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.437088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.438857 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.440023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6ae77921-ae9f-41c0-a781-fd50ca2d0f41 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.155948 Aug 10 22:57:10.440585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 537/1086] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:10 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:11.462363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:11.462973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:11.469866 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.470339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.470770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.471466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.471894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.472311 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.600614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:11.609232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:11.610755 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:11.611915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-67719c08-7e74-4c05-a3e9-0f3454127677 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.153440 Aug 10 22:57:11.612478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 550/1087] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:11 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:12.635186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:12.635802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:12.642944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:12.643435 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:12.643875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:12.644576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:12.645033 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:12.645495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:12.772380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:12.781115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:12.782641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:12.783795 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6902df67-91ac-4b0a-813c-95bf8d2d30bd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.152683 Aug 10 22:57:12.784354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 538/1088] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:12 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:13.807309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:13.807856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:13.814493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:13.814985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:13.815424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:13.816117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:13.816574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:13.817000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:13.951847 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:13.959657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:13.961157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:13.962345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-33ffd000-ffae-465e-9578-b36ec73c611c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.159132 Aug 10 22:57:13.962900 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 551/1089] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:13 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:14.987193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:14.987783 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:14.994167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:14.994640 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:14.995072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:14.995756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:14.996204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:14.996657 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:15.128885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:15.137305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:15.138983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:15.140537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cc61f760-4b6d-4f06-ae50-0554a5a3cd00 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.158500 Aug 10 22:57:15.141118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 539/1090] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:14 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:16.164109 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:16.164731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:16.172420 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:16.172954 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:16.173419 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:16.174117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:16.174570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:16.174995 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:16.308934 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:16.317514 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:16.318998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:16.320146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9e682c33-58cd-4fd7-b576-d6b4e638c705 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.160067 Aug 10 22:57:16.320720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 552/1091] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:16 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:17.343670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:17.344277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:17.350685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:17.351164 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:17.351603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:17.352321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:17.352782 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:17.353208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:17.484328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:17.492479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:17.494026 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:17.495178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c36283b7-882b-4106-8e63-1f5f83bdcd48 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.155524 Aug 10 22:57:17.495731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 540/1092] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:17 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:18.519810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:18.520421 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:18.526914 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:18.527398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:18.527839 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:18.528535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:18.528985 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:18.529449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:18.661183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:18.669244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:18.670791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:18.671962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-63073580-346d-45a7-9ab7-26debec0d198 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.156672 Aug 10 22:57:18.672646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 553/1093] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:18 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:19.695197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:19.695736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:19.702225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:19.702707 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:19.703145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:19.704014 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:19.704634 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:19.705061 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:19.835058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:19.843162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:19.845308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:19.846477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-62f27fc0-a043-4349-b823-fa0ca5890da8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.155331 Aug 10 22:57:19.847227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 541/1094] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:19 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:20.003499 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:20.004073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:20.010663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.011141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.011574 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.012268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.012719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.013150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.036902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b67c4db8-475a-42c6-b068-5d64e54dda4c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/ips" status: 200 len: 149 microversion: 2.1 time: 0.037581 Aug 10 22:57:20.037500 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 554/1095] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:57:19 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:20.868734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:20.869364 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:20.875721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.876204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.876638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.877550 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.878004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.878476 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:21.013043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:21.021442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:21.022961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:21.024105 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5b2ce2e3-2fdb-4c1f-9f60-73fed7503b7e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.159194 Aug 10 22:57:21.024656 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 542/1096] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:20 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:22.047624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:22.048728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:22.058289 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.058784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.059227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.059944 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.060400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.060830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.197925 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:22.210999 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:22.212495 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:22.213684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4b721aa8-d2db-43c7-99d2-a3d62e683072 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.170928 Aug 10 22:57:22.214233 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 555/1097] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:22 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:22.426538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db89764a-8fc6-48f3-b741-4f2d6352b888"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:22.428888 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:22.435710 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.436212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.436647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.437388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.438619 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.439358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.816562 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c018687f-be7d-4911-b25b-ea4a2a773b07 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394920 Aug 10 22:57:22.817162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 543/1098] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:57:22 2022] POST /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:23.238605 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:23.239319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:23.246291 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:23.246780 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:23.247096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:23.247953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:23.248455 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:23.248905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:23.397600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:23.405449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:23.407452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:23.408606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-12726856-52df-4bc5-8ff8-798e9abfae89 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.174794 Aug 10 22:57:23.409156 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 556/1099] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:23 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:24.435240 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:24.435930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:24.442925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:24.443400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:24.443830 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:24.444517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:24.444969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:24.445566 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:24.581780 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:24.589682 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:24.591179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:24.592335 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d34a2007-9036-4bea-9929-993b39a3cd94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.161996 Aug 10 22:57:24.592903 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 544/1100] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:24 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:25.615769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:25.616383 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:25.623058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:25.623552 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:25.624071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:25.624715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:25.625540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:25.626150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:25.856700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:25.865383 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:25.866892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:25.868107 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b1520960-3596-433f-8687-bcbc7633754b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.256198 Aug 10 22:57:25.868676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 557/1101] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:25 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:26.894465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:26.895118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:26.901754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.902242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.902683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:26.903380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.903837 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.904266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:27.034241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:27.042087 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:27.043598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:27.044752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c081598b-25ea-4c96-ae7d-6a5bdda8695c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.155224 Aug 10 22:57:27.045327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 545/1102] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:26 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:28.068256 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:28.068864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:28.075059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.075543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.075982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:28.076673 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.077137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.077584 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:28.215428 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:28.223585 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:28.225133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:28.226324 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3fd11b73-7e02-4820-925e-2796560f3f24 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.161972 Aug 10 22:57:28.226878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 558/1103] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:28 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:29.250768 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:29.251479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:29.257876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:29.258365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:29.258811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:29.259764 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:29.260219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:29.260645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:29.395652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:29.404839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:29.406363 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:29.407507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7c0b72f2-bb9c-4aa5-949c-a13b3029e03e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.161194 Aug 10 22:57:29.408056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 546/1104] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:29 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:30.430040 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:30.430650 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:30.437328 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:30.437817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:30.438255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:30.438953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:30.439406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:30.439831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:30.572340 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:30.581114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:30.582643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:30.583819 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-158c0de5-59db-4fac-b760-54da30369359 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.157734 Aug 10 22:57:30.584381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 559/1105] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:30 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:57:31.608260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:31.608876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:31.616136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:31.616623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:31.617062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.617797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:31.618254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:31.618688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.752289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:31.760417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:31.761931 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:31.763100 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a2765e95-a709-4361-8b0a-7dc0f153d8d9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.158763 Aug 10 22:57:31.763652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 547/1106] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:31 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:32.786513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:32.787155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:32.793614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:32.794100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:32.794540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:32.795231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:32.795682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:32.796108 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:32.928836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:32.936698 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:32.939133 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:32.940316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-83c39e58-b04a-4ae0-8bef-5bd09b6d71c7 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.157715 Aug 10 22:57:32.940879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 560/1107] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:32 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:57:34.101554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:34.102175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:34.104093 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=29 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:34.109627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.110135 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.110589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:34.111293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.111757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.112217 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:34.114969 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:34.245582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:34.253711 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:34.255205 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:34.256357 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c398d2a3-bbbe-47bf-9610-9ea83b7982cd tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.295038 Aug 10 22:57:34.256912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 548/1108] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:33 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:35.279997 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:35.281204 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:35.287681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.288158 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.288594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.289484 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.289792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.290200 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.294763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:35.427950 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.435965 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.438587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.439809 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4874b308-a0b4-4d82-bd7e-21f005a05aa6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.163785 Aug 10 22:57:35.440374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 561/1109] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:35 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:35.641214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db89764a-8fc6-48f3-b741-4f2d6352b888"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:35.648098 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:35.654760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.655248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.655785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.656622 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.657079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.657538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.740414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Invalid volume: volume db89764a-8fc6-48f3-b741-4f2d6352b888 is already attached to instances: 27093fe9-e428-4e9d-b997-dc252de8ae3d Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: POST /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments HTTP/1.1 Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 74 Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:57:35.742186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {"volumeAttachment": {"volumeId": "db89764a-8fc6-48f3-b741-4f2d6352b888"}} Aug 10 22:57:35.743896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Invalid volume: volume db89764a-8fc6-48f3-b741-4f2d6352b888 is already attached to instances: 27093fe9-e428-4e9d-b997-dc252de8ae3d Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'server_id': '27093fe9-e428-4e9d-b997-dc252de8ae3d', 'body': {'volumeAttachment': {'volumeId': 'db89764a-8fc6-48f3-b741-4f2d6352b888'}}} Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume db89764a-8fc6-48f3-b741-4f2d6352b888 is already attached to instances: 27093fe9-e428-4e9d-b997-dc252de8ae3d Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:35.744821 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume db89764a-8fc6-48f3-b741-4f2d6352b888 is already attached to instances: 27093fe9-e428-4e9d-b997-dc252de8ae3d Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:35.746306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume db89764a-8fc6-48f3-b741-4f2d6352b888 is already attached to instances: 27093fe9-e428-4e9d-b997-dc252de8ae3d Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 400 to user: Invalid volume: volume db89764a-8fc6-48f3-b741-4f2d6352b888 is already attached to instances: 27093fe9-e428-4e9d-b997-dc252de8ae3d {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2202df4d-afe3-49ba-ba68-47700344f821 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108849 Aug 10 22:57:35.748048 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 549/1110] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:57:35 2022] POST /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:57:35.807914 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:35.808324 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:35.810171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=31 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:35.816113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.816597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.817036 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.817760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.818219 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.818646 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.897763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.objects.instance [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lazy-loading 'services' on Instance uuid 27093fe9-e428-4e9d-b997-dc252de8ae3d {{(pid=132540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:35.972890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3b763e73-7e51-45db-8aa0-f8d46be05dfe tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments/db89764a-8fc6-48f3-b741-4f2d6352b888" status: 202 len: 0 microversion: 2.1 time: 0.168758 Aug 10 22:57:35.973521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 562/1111] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:57:35 2022] DELETE /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments/db89764a-8fc6-48f3-b741-4f2d6352b888 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:57:35.983147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:35.986327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:35.994060 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.994620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.995322 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.996148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.996881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.997384 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.031762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-02b70ddc-02d4-4f00-a829-d02686db88a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053588 Aug 10 22:57:36.032207 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 550/1112] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:57:35 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:36.463538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:36.464227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:36.471006 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:36.471485 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:36.471918 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.472606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:36.473060 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:36.473508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.605062 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:36.613193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:36.614728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:36.615886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a7de4581-eaa0-4b1e-8433-a99b47863701 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.157115 Aug 10 22:57:36.616441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 563/1113] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:36 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:37.020802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-1eab3e4e-f77d-4dea-8603-5a7fc17da7e6 req-b92c7146-34e7-4620-86d6-004c263ddcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1bb3-65ab-404d-b358-0b580e3559d9", "name": "network-vif-plugged", "status": "completed", "tag": "cee28bdd-1335-44c1-9da4-99dfff6ebedf"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:37.030951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-1eab3e4e-f77d-4dea-8603-5a7fc17da7e6 req-b92c7146-34e7-4620-86d6-004c263ddcca service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.031437 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-1eab3e4e-f77d-4dea-8603-5a7fc17da7e6 req-b92c7146-34e7-4620-86d6-004c263ddcca service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.031962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-1eab3e4e-f77d-4dea-8603-5a7fc17da7e6 req-b92c7146-34e7-4620-86d6-004c263ddcca service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.043624 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-1eab3e4e-f77d-4dea-8603-5a7fc17da7e6 req-b92c7146-34e7-4620-86d6-004c263ddcca service nova] Creating event network-vif-plugged:cee28bdd-1335-44c1-9da4-99dfff6ebedf for instance 063e1bb3-65ab-404d-b358-0b580e3559d9 on hv-cinder-83608 Aug 10 22:57:37.044511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:37.049045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-1eab3e4e-f77d-4dea-8603-5a7fc17da7e6 req-b92c7146-34e7-4620-86d6-004c263ddcca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 Aug 10 22:57:37.050253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 551/1114] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:37.050713 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:37.056606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.057090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.057795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.058802 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.059265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.059784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.091265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4754f9cf-3ac0-4fcc-80bb-97e37ed3bec9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050636 Aug 10 22:57:37.091882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 564/1115] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:57:37 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:37.639839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:37.641251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:37.647610 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.648097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.648571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.649294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.649757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.650213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.782019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.790533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.792071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.793233 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-863c6f18-928c-4b66-a59a-542e671ad625 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.157758 Aug 10 22:57:37.793813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 552/1116] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:37 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:38.103622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:38.105826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:38.113249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.113761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.114201 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.114896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.115347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.115774 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.144764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0a1607f4-8194-43c9-86d1-34f63d45fef3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045073 Aug 10 22:57:38.145354 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 565/1117] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:57:38 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:57:38.208350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:38.209289 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:38.215668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.216250 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.216692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.217427 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.217891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.218879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.244514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:57:38.320660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9e9ca328-434d-415b-8f62-321783ca6d08 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 204 len: 0 microversion: 2.1 time: 0.115667 Aug 10 22:57:38.321500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 553/1118] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:57:38 2022] DELETE /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:57:38.329699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:38.330309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:38.336277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.336756 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.337194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.337906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.338359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.338814 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.472772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:38.480321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-bb17e467-dfc5-4415-8586-28729752bf74 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1681 microversion: 2.1 time: 0.154554 Aug 10 22:57:38.480893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 566/1119] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:38 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:38.817666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:38.818279 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:38.824180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.824659 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.825091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.825813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.826269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.826696 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.958979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:38.966844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:38.968446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:38.969633 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e506c3ba-4c5b-4ea3-8f05-68e8c36c4e37 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.156368 Aug 10 22:57:38.970196 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 554/1120] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:38 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:39.502815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:39.503422 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:39.510150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:39.510630 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:39.511059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:39.511741 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:39.512190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:39.512608 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:39.644513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:39.652309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-04e597fa-c00f-4a92-a096-8fa0eb0aa386 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1681 microversion: 2.1 time: 0.153981 Aug 10 22:57:39.652881 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 567/1121] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:39 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:39.992266 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:39.992869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:39.999426 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:39.999905 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.000347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.001038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:40.001538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.001943 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.134527 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:40.143324 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:40.144831 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:40.146021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-04e9a383-2cd2-40b6-9c4a-e04fade9dc6c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.157727 Aug 10 22:57:40.146581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 555/1122] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:39 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:40.674123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:40.674734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:40.681095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:40.681658 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.682048 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.682768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:40.683223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.683651 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.814379 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:40.821973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-06e1313e-2a6b-4b1b-a224-f9fb0e7d5535 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1681 microversion: 2.1 time: 0.151745 Aug 10 22:57:40.822544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 568/1123] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:40 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:41.169860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:41.170470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:41.177553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:41.178033 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:41.178464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:41.179151 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:41.179599 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:41.180018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:41.313627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:41.323428 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:41.326245 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:41.328033 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-34cf7d9a-39ae-4fba-a169-f527be280a94 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.161740 Aug 10 22:57:41.329052 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 556/1124] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:41 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:41.982746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:41.983397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:41.989334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:41.989818 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:41.990251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:41.990936 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:41.991381 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:41.991799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:42.119676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:42.128252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-effbf140-9b35-4b76-86c3-22d9f1fd293c tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1681 microversion: 2.1 time: 0.289037 Aug 10 22:57:42.128815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 569/1125] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:41 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:42.354090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:42.354726 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:42.361777 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:42.362263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:42.362700 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:42.363397 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:42.363851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:42.364306 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:42.426136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 22:57:42.426343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 22:57:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 (ip 10.222.0.76) !!! Aug 10 22:57:42.500593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:42.508934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:42.510479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:42.511626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a9703cc8-7a03-47c6-8ee7-edea9acf91d6 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.161499 Aug 10 22:57:42.512210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 557/1126] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:42 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:43.150303 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:43.150895 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:43.157739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:43.158225 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:43.158657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:43.159348 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:43.159792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:43.160209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:43.289416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.297472 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-809beea6-9f20-4c05-be3a-86a6e114c6a9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1681 microversion: 2.1 time: 0.151013 Aug 10 22:57:43.298038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 570/1127] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:43 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:43.535641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:43.536254 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:43.542705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:43.543194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:43.543635 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:43.544336 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:43.544804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:43.545238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:43.675860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.683994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.685444 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.687526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9d950c5a-2dc7-44bd-9cbe-28f5afb05a02 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.154889 Aug 10 22:57:43.688077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 558/1128] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:43 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:44.318965 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:44.319753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:44.326072 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.326553 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.326994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:44.327697 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.328150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.328577 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:44.476917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:44.485020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ef64b3ee-29d0-4418-8c2a-0d895297c359 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1681 microversion: 2.1 time: 0.170022 Aug 10 22:57:44.485728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 571/1129] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:44 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:44.711234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:44.711896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:44.718822 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.719424 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.719737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:44.720454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.720909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.721368 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:44.855517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:44.864274 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:44.865807 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:44.866971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5dd3b5ba-b998-4351-acb5-42f64315217c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.159841 Aug 10 22:57:44.867560 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 559/1130] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:44 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:45.505981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:45.506601 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:45.513126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:45.513643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:45.514078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:45.515378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:45.515832 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:45.516245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:45.649463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:45.657511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-49d3bbaf-91b3-4d56-9e8b-84d78623aa25 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1681 microversion: 2.1 time: 0.155268 Aug 10 22:57:45.658137 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 572/1131] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:45 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:45.891037 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:45.891638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:45.898245 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:45.898910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:45.899355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:45.900056 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:45.900552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:45.900924 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.033565 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:46.042490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:46.043994 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:46.045155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-07339885-8494-4ecf-bcd7-984981f8d8a3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1744 microversion: 2.20 time: 0.158763 Aug 10 22:57:46.046286 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 560/1132] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:45 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:46.679591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:46.680301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:46.688254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.688815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.689351 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.690181 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.690710 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.691140 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.762191 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:46.770742 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e7618cde-ce41-486e-be13-c51d9c7c3e70 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1614 microversion: 2.1 time: 0.095028 Aug 10 22:57:46.771703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 573/1133] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:46 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:46.967004 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-c6bccceb-ceaa-4f37-9b3e-9cb4f31bbf02 req-30582ff8-1d3e-4372-9f1a-4872abb8ece3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27093fe9-e428-4e9d-b997-dc252de8ae3d", "name": "network-vif-deleted", "tag": "07da3b5f-f66e-485e-8d5c-51d2fe563c69"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:46.990114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-c6bccceb-ceaa-4f37-9b3e-9cb4f31bbf02 req-30582ff8-1d3e-4372-9f1a-4872abb8ece3 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.995486 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-c6bccceb-ceaa-4f37-9b3e-9cb4f31bbf02 req-30582ff8-1d3e-4372-9f1a-4872abb8ece3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.996147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-c6bccceb-ceaa-4f37-9b3e-9cb4f31bbf02 req-30582ff8-1d3e-4372-9f1a-4872abb8ece3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.027329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-c6bccceb-ceaa-4f37-9b3e-9cb4f31bbf02 req-30582ff8-1d3e-4372-9f1a-4872abb8ece3 service nova] Creating event network-vif-deleted:07da3b5f-f66e-485e-8d5c-51d2fe563c69 for instance 27093fe9-e428-4e9d-b997-dc252de8ae3d on hv-cinder-83608 Aug 10 22:57:47.033986 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-c6bccceb-ceaa-4f37-9b3e-9cb4f31bbf02 req-30582ff8-1d3e-4372-9f1a-4872abb8ece3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076929 Aug 10 22:57:47.036557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 561/1134] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:47.069619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:47.069858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:47.083416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.084333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.085403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.086417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.086886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.087840 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.344694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:47.357077 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:47.359863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:47.361586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-184d6e30-b8ec-48eb-af46-98623148d542 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.296334 Aug 10 22:57:47.363444 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 574/1135] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:47 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:47.793503 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:47.794121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:47.808307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.809515 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.810250 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.811263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.811945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.812606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.853204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.854091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.854781 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.855867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lazy-loading 'fault' on Instance uuid 27093fe9-e428-4e9d-b997-dc252de8ae3d {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:47.918408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:47.930893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c7efb99a-7b60-422a-abee-091777cdf8f3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 200 len: 1332 microversion: 2.1 time: 0.142039 Aug 10 22:57:47.931575 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 562/1136] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:47 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:48.389816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.390770 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:48.398448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.399168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.399768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.400637 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.401414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.401994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.563568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.575051 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.577194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.579122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ad656650-1ad2-44d9-83fa-f8fcfc374637 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.193645 Aug 10 22:57:48.594050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 575/1137] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:48.956500 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.957145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:48.965519 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.966052 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.966691 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.967525 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.968013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.968514 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.991351 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d HTTP/1.1 Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:57:48.996223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 22:57:48.998050 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '27093fe9-e428-4e9d-b997-dc252de8ae3d'} Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:48.999945 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 22:57:49.003493 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:57:49.005598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:49.005598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-441897af-6abd-4d20-a5df-f91c4e969071 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 404 len: 111 microversion: 2.1 time: 0.047796 Aug 10 22:57:49.005598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 563/1138] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:57:49.015585 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-869f36b9-c2a7-422c-8b45-c574518e666b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '.version_select at 0x7fa9be6ace50>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:49.045904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-869f36b9-c2a7-422c-8b45-c574518e666b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227424170" status: 202 len: 0 microversion: 2.1 time: 0.037887 Aug 10 22:57:49.047343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 576/1139] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 10 22:57:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227424170 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:57:49.603099 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:49.603772 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:49.611594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:49.612472 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:49.613333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:49.614454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:49.615217 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:49.615934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:49.774267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:49.777077 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7905f3d1-f178-4757-b7dc-7f79cbd5b8a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: .version_select at 0x7fa9be8411f0>, body: {"keypair": {"name": "tempest-keypair-676143079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyEmgmUjm/Ug2YRmn415u8c8h/4PB5Tg3QvmTodvvzj2Hoqd43qzStINAhbY54pTMTNOS49qqzXahaMhX7dLz8u0V1KEHqW3FLvBZrXf/YvAvZE4ES0nLKbe2lsi7VdQA=="}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:49.790314 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:49.793860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:49.796984 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:49.798439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-eb105e43-cdb9-4f31-b47f-073fc070a24b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.199511 Aug 10 22:57:49.799182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-7905f3d1-f178-4757-b7dc-7f79cbd5b8a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:49.810667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 564/1140] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:49 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:49.818240 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-7905f3d1-f178-4757-b7dc-7f79cbd5b8a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'key_pairs'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:49.856806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7905f3d1-f178-4757-b7dc-7f79cbd5b8a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084407 Aug 10 22:57:49.869478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 577/1141] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 22:57:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:57:50.821869 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:50.824030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:50.839446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:50.841373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:50.844460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:50.845704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:50.846236 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:50.846819 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:51.065933 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:51.075233 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:51.077676 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:51.079558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f161f271-09ad-43cb-8814-89c247b76d28 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.261729 Aug 10 22:57:51.094291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 565/1142] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:50 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:52.006280 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1034816438", "imageRef": "603fc397-9d36-45b1-88fe-ef430338d55a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67b001b8-3d70-41ad-865c-43e8ac074765"}], "security_groups": [{"name": "tempest-securitygroup--504816178"}], "key_name": "tempest-keypair-676143079", "user_data": "}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:52.105871 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:52.106552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:52.118891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:52.121959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:52.122495 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:52.124543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:52.125216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:52.133372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:52.142909 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] validate_networks() for [('67b001b8-3d70-41ad-865c-43e8ac074765', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:57:52.699138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:52.714185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:52.715767 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:52.717006 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1d0c155c-2563-4a58-b100-4252db0ccfd9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.616853 Aug 10 22:57:52.717600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 566/1143] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:52 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:57:53.171165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:57:53.172268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:57:53.173092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:57:53.173908 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:57:53.174370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:57:53.183901 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.185578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.186902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.187658 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.188124 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.188591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.209188 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:53.213352 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Getting quotas for user da22fc66a1d14fa983463331de110258 and project 89c0b68704e04cdd84f27922e4da5e5d. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:53.226178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:57:53.228709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='603fc397-9d36-45b1-88fe-ef430338d55a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:57:53.300139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ba33115b-12ad-46f1-b174-450d4c1dd1d8 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.298362 Aug 10 22:57:53.301237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 578/1144] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 22:57:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:57:53.314313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f94164fd-0b87-481b-966a-89b3dc0f4d7e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:53.315166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f94164fd-0b87-481b-966a-89b3dc0f4d7e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:53.409130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f94164fd-0b87-481b-966a-89b3dc0f4d7e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:53.421598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f94164fd-0b87-481b-966a-89b3dc0f4d7e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1241 microversion: 2.1 time: 0.109162 Aug 10 22:57:53.425891 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 567/1145] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:53 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:53.742221 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:53.742848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:53.754641 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.755138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.755571 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.756415 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.756812 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.757664 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.983782 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:53.987805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:53.997008 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:53.999952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:54.001451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-513b2bd3-96a3-4ef9-8724-2abde96351be tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.263111 Aug 10 22:57:54.002507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 579/1146] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:53 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:54.450334 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:54.453019 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:54.465835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.467838 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.468866 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.470252 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.471180 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.472011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.555088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:54.564224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4c085df4-1a32-4799-abc3-d23d65ae84ec tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1293 microversion: 2.1 time: 0.119328 Aug 10 22:57:54.565155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 568/1147] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:54 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:55.032037 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:55.032649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:55.046569 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.047228 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.047823 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.048967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.049555 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.051496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.252342 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.261548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.263047 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.264293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-266a70b2-e24c-40bb-8b97-57938b9dc01e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.238105 Aug 10 22:57:55.265142 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 580/1148] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:55 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:55.586833 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:55.587445 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:55.607865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.609873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.610849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.611847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.612482 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.613104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.719288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.730172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7a42edcd-6ccc-4221-9f18-673e75e2fd54 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1299 microversion: 2.1 time: 0.147816 Aug 10 22:57:55.741505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 569/1149] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:55 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:56.290207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:56.290979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:56.305638 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.307754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.308454 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.314348 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.315235 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.316445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.615246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.628564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.631373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.634686 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-96f2b416-b295-4b32-9be4-ef65709cce85 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.350370 Aug 10 22:57:56.653716 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 581/1150] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:56 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:56.753133 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:56.753835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:56.776490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.777002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.777535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.778275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.780840 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.781228 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.981011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.993797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cb8361b7-4cfe-45d6-83cf-2c7afa5d08fd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.244847 Aug 10 22:57:56.994637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 570/1151] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:56 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:57.203824 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-ceffb264-abb1-4f62-888f-20cf46bc6a41 req-749d94ab-1382-4480-9a05-6eb573f92527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c99b7b-2f26-480c-86d9-a0d06ae6202c", "tag": "606da499-b569-4803-9ab1-b21cfc0c7aff"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:57.214405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-ceffb264-abb1-4f62-888f-20cf46bc6a41 req-749d94ab-1382-4480-9a05-6eb573f92527 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.214883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-ceffb264-abb1-4f62-888f-20cf46bc6a41 req-749d94ab-1382-4480-9a05-6eb573f92527 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.215535 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-ceffb264-abb1-4f62-888f-20cf46bc6a41 req-749d94ab-1382-4480-9a05-6eb573f92527 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.243861 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-ceffb264-abb1-4f62-888f-20cf46bc6a41 req-749d94ab-1382-4480-9a05-6eb573f92527 service nova] Creating event network-changed:606da499-b569-4803-9ab1-b21cfc0c7aff for instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c on hv-cinder-83608 Aug 10 22:57:57.252591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-ceffb264-abb1-4f62-888f-20cf46bc6a41 req-749d94ab-1382-4480-9a05-6eb573f92527 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053029 Aug 10 22:57:57.254061 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 582/1152] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:57.661829 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:57.662439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:57.668944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.670168 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.670950 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.671683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.672147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.672582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.865989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:57.877171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:57.878724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:57.880125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f58838fb-dff4-4601-9f3a-217670e4c957 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.222338 Aug 10 22:57:57.881485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 571/1153] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:57 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:58.018953 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:58.019736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:58.026831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.027760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.028406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.029404 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.030187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.030844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.203159 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:58.211763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4094e316-e486-4665-989b-b4f34cf01093 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.199219 Aug 10 22:57:58.212422 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 583/1154] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:58 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:58.910447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:58.911915 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:58.919893 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.920394 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.920837 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.921664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.922125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.922632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:59.089853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:59.103961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:59.105528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:59.107582 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cc346343-e314-4aaf-815d-a74356930a75 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.205268 Aug 10 22:57:59.108400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 572/1155] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:58 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:59.233123 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:59.233790 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:59.247343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:59.250031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:59.250817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:59.252529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:59.253213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:59.253848 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:59.417050 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:59.426719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8884e52a-bf23-4a61-83f9-925727af0543 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.198109 Aug 10 22:57:59.432154 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 584/1156] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:59 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:00.135225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:00.136075 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:00.143985 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.144577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.145166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.146062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.146513 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.146933 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.288136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:00.296185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:00.297721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:00.298899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-907f3836-ec41-4fdc-842f-5359fb57c121 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1739 microversion: 2.20 time: 0.167814 Aug 10 22:58:00.299462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 573/1157] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:00 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:58:00.448575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:00.449362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:00.464587 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.465081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.465575 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.466831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.467285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.467712 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.612066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:00.620147 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-9479beef-5d84-479d-a022-ce784e4e3ce1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.175946 Aug 10 22:58:00.620981 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 585/1158] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:00 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:01.321864 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:01.322612 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:01.329759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:01.330246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:01.330686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:01.331386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:01.332147 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:01.332268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:01.497453 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:01.507919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:01.509946 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:01.511360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-565823da-d23d-412a-ae10-e235b7f0be8f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1721 microversion: 2.20 time: 0.193458 Aug 10 22:58:01.511921 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 574/1159] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:01 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:58:01.648125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:01.648984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:01.659856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:01.660104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:01.660606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:01.661634 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:01.662100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:01.662747 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:01.831163 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:01.839085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a9ce9ee9-95fb-46e5-8744-1278472b522a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.200094 Aug 10 22:58:01.839746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 586/1160] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:01 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:02.535106 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:02.535721 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:02.542204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:02.542694 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:02.543133 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:02.544537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:02.545229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:02.545686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:02.680425 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:02.689523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:02.690967 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:02.692132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9271da60-3a6b-444e-9f47-7a669b7be399 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1721 microversion: 2.20 time: 0.161067 Aug 10 22:58:02.692686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 575/1161] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:02 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:02.860560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:02.861327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:02.868333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:02.868827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:02.869266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:02.869996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:02.870450 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:02.870872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:03.008661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:03.016560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-999aa44d-6768-4d42-965e-71837443c9dd tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.160209 Aug 10 22:58:03.017437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 587/1162] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:02 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:03.155281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-5462d67a-7184-4ea5-81d4-9dab9ee8885a req-c94e0166-cfbb-4e31-87d1-bfb497c3a5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c99b7b-2f26-480c-86d9-a0d06ae6202c", "name": "network-vif-plugged", "status": "completed", "tag": "606da499-b569-4803-9ab1-b21cfc0c7aff"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:03.170465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-5462d67a-7184-4ea5-81d4-9dab9ee8885a req-c94e0166-cfbb-4e31-87d1-bfb497c3a5c2 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:03.174165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-5462d67a-7184-4ea5-81d4-9dab9ee8885a req-c94e0166-cfbb-4e31-87d1-bfb497c3a5c2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:03.174165 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-5462d67a-7184-4ea5-81d4-9dab9ee8885a req-c94e0166-cfbb-4e31-87d1-bfb497c3a5c2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:03.189758 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-5462d67a-7184-4ea5-81d4-9dab9ee8885a req-c94e0166-cfbb-4e31-87d1-bfb497c3a5c2 service nova] Creating event network-vif-plugged:606da499-b569-4803-9ab1-b21cfc0c7aff for instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c on hv-cinder-83608 Aug 10 22:58:03.197182 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-5462d67a-7184-4ea5-81d4-9dab9ee8885a req-c94e0166-cfbb-4e31-87d1-bfb497c3a5c2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048773 Aug 10 22:58:03.198212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 576/1163] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:03.716536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:03.717289 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:03.720379 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:03.721111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=10 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:03.727136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:03.727626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:03.728067 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:03.728775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:03.729232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:03.729682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:03.868146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:03.877058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:03.878606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:03.879775 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a49fbdc3-0fbe-4570-916a-31cc00b49629 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1721 microversion: 2.20 time: 0.168328 Aug 10 22:58:03.880348 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 588/1164] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:03 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:04.035797 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:04.040481 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:04.041206 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:04.048157 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.048636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.049066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.049776 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.050226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.050646 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.189177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:04.197346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b7ae2a6c-e7d0-4c36-9668-5e0a31dbfd46 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.162420 Aug 10 22:58:04.198039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 577/1165] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:04 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:04.904391 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:04.904991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:04.913000 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.913521 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.913955 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.914645 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.915092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.915516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.046801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:05.054754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:05.056264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:05.057463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-eafb5bff-2e1f-4392-a9bc-a3f84d42a17e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1724 microversion: 2.20 time: 0.157856 Aug 10 22:58:05.058032 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 589/1166] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:04 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:05.083199 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82b67b8f-931a-46d3-886d-a3a88158dc50"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:05.086034 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:05.088354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:05.094489 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.094981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.095421 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.096140 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.096601 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.097136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.219701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:05.220321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:05.226251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.226744 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.227181 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.227883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.228338 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.228769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.373041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:05.380932 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7430490f-2683-4419-bc37-01f26655b8f2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1366 microversion: 2.1 time: 0.165303 Aug 10 22:58:05.381805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 590/1167] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:05 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:05.385936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-f031ce4b-4af7-4522-9164-be39ef757c84 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307623 Aug 10 22:58:05.386198 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-70e03967-90ce-462f-9ccc-742ea1a3cdea req-41021cff-8c27-4657-81ae-146f89dc0d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1bb3-65ab-404d-b358-0b580e3559d9", "name": "network-vif-unplugged", "status": "completed", "tag": "cee28bdd-1335-44c1-9da4-99dfff6ebedf"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:05.387097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 578/1168] 10.222.0.76 () {62 vars in 1364 bytes} [Wed Aug 10 22:58:05 2022] POST /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:58:05.402125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-70e03967-90ce-462f-9ccc-742ea1a3cdea req-41021cff-8c27-4657-81ae-146f89dc0d70 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.402614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-70e03967-90ce-462f-9ccc-742ea1a3cdea req-41021cff-8c27-4657-81ae-146f89dc0d70 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.403580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-70e03967-90ce-462f-9ccc-742ea1a3cdea req-41021cff-8c27-4657-81ae-146f89dc0d70 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.415270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.compute.server_external_events [req-70e03967-90ce-462f-9ccc-742ea1a3cdea req-41021cff-8c27-4657-81ae-146f89dc0d70 service nova] Unable to find a host for instance 063e1bb3-65ab-404d-b358-0b580e3559d9. Dropping event network-vif-unplugged {{(pid=132540) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 22:58:05.416358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-70e03967-90ce-462f-9ccc-742ea1a3cdea req-41021cff-8c27-4657-81ae-146f89dc0d70 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033648 Aug 10 22:58:05.417104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 591/1169] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 22:58:05.519928 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:05.520432 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:05.526529 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.526954 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.527396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.528413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.528889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.529355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.615942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:05.766956 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3b012221-28d0-444b-867e-9f84a30a69b8 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-volume_attachments/82b67b8f-931a-46d3-886d-a3a88158dc50" status: 202 len: 0 microversion: 2.20 time: 0.251106 Aug 10 22:58:05.769583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 579/1170] 10.222.0.76 () {60 vars in 1457 bytes} [Wed Aug 10 22:58:05 2022] DELETE /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-volume_attachments/82b67b8f-931a-46d3-886d-a3a88158dc50 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:05.848725 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:05.849396 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:05.851279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:05.857671 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.858611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.858611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.859272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.859728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.860154 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.894049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132540) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 22:58:05.967998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4426bf62-758d-42d2-8e20-c05811b779de tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "POST /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/action" status: 202 len: 0 microversion: 2.20 time: 0.122472 Aug 10 22:58:05.968667 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 592/1171] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 10 22:58:05 2022] POST /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:05.977013 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:05.978128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:05.986507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.987011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.987453 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.988750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.989401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.989991 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:06.141559 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:06.150573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:06.152237 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:06.154017 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cdc5eded-b967-4313-866a-cefc2a7e0ba1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1672 microversion: 2.20 time: 0.180954 Aug 10 22:58:06.155253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 580/1172] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:05 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:06.404998 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:06.405977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:06.428907 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:06.429462 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:06.430265 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:06.431145 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:06.431914 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:06.436497 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:06.678043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:06.687543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-45c61440-f447-4910-8eee-b23847c52271 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1555 microversion: 2.1 time: 0.287923 Aug 10 22:58:06.689310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 593/1173] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:06 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:06.710683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:06.711186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:06.720754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:06.721365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:06.722066 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:06.723101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:06.723763 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:06.724311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:06.831131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2910d403-6fae-4acb-a760-cfd6418df1e9 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125503 Aug 10 22:58:06.831820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 581/1174] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 10 22:58:06 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:58:07.181717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:07.183054 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:07.192301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:07.193212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:07.194300 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:07.195465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:07.196510 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:07.197254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:07.436891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:07.444977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:07.446762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:07.447939 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-55b9b6dc-4336-4cb7-a508-a5dc001a9835 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1674 microversion: 2.20 time: 0.272049 Aug 10 22:58:07.448705 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 594/1175] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:07 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1674 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:58:08.227091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-c720739c-5c4b-408b-af44-c6c0b0d0d691 req-2e91bba3-bcd8-498a-8bd0-22a07f0667db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c99b7b-2f26-480c-86d9-a0d06ae6202c", "tag": "606da499-b569-4803-9ab1-b21cfc0c7aff"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:08.238605 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-c720739c-5c4b-408b-af44-c6c0b0d0d691 req-2e91bba3-bcd8-498a-8bd0-22a07f0667db service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:08.239341 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-c720739c-5c4b-408b-af44-c6c0b0d0d691 req-2e91bba3-bcd8-498a-8bd0-22a07f0667db service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:08.240231 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-c720739c-5c4b-408b-af44-c6c0b0d0d691 req-2e91bba3-bcd8-498a-8bd0-22a07f0667db service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:08.255365 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-c720739c-5c4b-408b-af44-c6c0b0d0d691 req-2e91bba3-bcd8-498a-8bd0-22a07f0667db service nova] Creating event network-changed:606da499-b569-4803-9ab1-b21cfc0c7aff for instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c on hv-cinder-83608 Aug 10 22:58:08.261906 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-c720739c-5c4b-408b-af44-c6c0b0d0d691 req-2e91bba3-bcd8-498a-8bd0-22a07f0667db service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040483 Aug 10 22:58:08.262770 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 582/1176] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:08.474773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:08.476296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:08.488230 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:08.489525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:08.490208 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:08.492334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:08.492990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:08.494179 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:08.763649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:08.774945 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:08.780758 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:08.782397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-858a4ef7-4311-4ca1-81ad-7c30914b8909 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.314106 Aug 10 22:58:08.782878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 595/1177] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:08 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:09.808906 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:09.809705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:09.815934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:09.816414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:09.816847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:09.817577 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:09.818030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:09.818452 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:09.969985 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:09.981097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:09.983342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:09.984539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5d013daf-c07c-488b-9d2f-af83c6b68088 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.180560 Aug 10 22:58:09.985260 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 583/1178] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:09 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:11.008257 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:11.009557 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:11.017344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.018001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.018469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.020084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.020662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.021316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.163095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:11.166556 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:11.171861 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:11.173578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:11.174760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b336c6c1-a0cf-4022-ad26-329fbcb4ae1c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.170695 Aug 10 22:58:11.175331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 596/1179] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:11 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:12.202062 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:12.202778 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:12.210589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:12.211089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:12.211534 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.212255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:12.212713 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:12.213145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.363737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:12.372959 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:12.374507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:12.375681 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a49759d7-df02-470a-879f-76013954a9ec tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.177577 Aug 10 22:58:12.376244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 584/1180] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:12 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:13.402795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:13.404399 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:13.413330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:13.414268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:13.415045 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:13.416073 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:13.416902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:13.417752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:13.598398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:13.607905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:13.609452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:13.610649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-88757142-694a-42c9-bc12-381c43000b2e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.212257 Aug 10 22:58:13.611222 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 597/1181] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:13 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:14.635391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:14.636761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:14.644346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:14.644917 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:14.645470 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.646555 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:14.647249 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:14.648085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.812359 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:14.820850 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:14.822688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:14.824734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9fe01728-4af8-4114-8a71-7535fd77ab25 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.193225 Aug 10 22:58:14.841353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 585/1182] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:14 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:15.848861 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:15.850361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:15.860347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.861310 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.862095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:15.863277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.863892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.864548 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:16.010479 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:16.019666 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:16.021160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:16.022362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-28a36c18-8945-4fc2-ae4d-d6dd87570ee1 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.178042 Aug 10 22:58:16.022917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 598/1183] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:15 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:17.046496 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:17.047112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:17.054267 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.054757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.055190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.055896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.056343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.056765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.200533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:17.208554 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:17.210097 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:17.211587 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-51551616-b204-4faa-ab54-3be074667e34 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.169723 Aug 10 22:58:17.212136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 586/1184] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:17 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:18.237031 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:18.238476 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:18.245556 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:18.245975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:18.247044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:18.247759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:18.248213 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:18.248643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:18.392049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:18.400682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:18.402505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:18.404437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-250e16b9-1065-42c9-bb8c-54fd8d972e20 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.172345 Aug 10 22:58:18.409611 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 599/1185] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:18 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:19.427921 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:19.428536 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:19.435801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:19.436395 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:19.437018 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:19.437885 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:19.438526 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:19.439204 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:19.576732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:19.585308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:19.587088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:19.588371 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-19081c32-cdaa-4d91-86cc-70ae77b857ae tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.164316 Aug 10 22:58:19.588932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 587/1186] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:19 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:20.612570 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:20.613181 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:20.620339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:20.621363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:20.621826 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:20.622566 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:20.623129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:20.623600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:20.760416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:20.768862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:20.770400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:20.771557 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2e6e2083-f233-4eed-9102-036d550b135a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.162871 Aug 10 22:58:20.772117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 600/1187] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:20 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:21.796127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:21.796671 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:21.803106 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:21.803597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:21.804038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:21.804739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:21.805198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:21.805652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:21.943423 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:21.951302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:21.952792 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:21.953983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1a979e6a-0542-420a-9b08-513e295b6d97 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.162987 Aug 10 22:58:21.954553 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 588/1188] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:21 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:22.976845 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:22.977427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:22.983890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.984371 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.984806 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.985583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.985987 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.986414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:23.122474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:23.130564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:23.132058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:23.133210 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-22cce34c-e82e-471e-8880-7fa503faa529 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.160486 Aug 10 22:58:23.133793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 601/1189] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:22 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:24.157655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:24.158224 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:24.164687 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.165172 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.165644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.166345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.166803 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.167231 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.309542 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:24.317605 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:24.319112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:24.320277 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b00dcad5-5efb-4e0e-b0ac-0782cf0edeff tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.166960 Aug 10 22:58:24.320834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 589/1190] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:24 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:25.345439 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:25.346175 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:25.352572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.353059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.353541 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.354238 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.354691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.355226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.488764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.497377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.498893 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.500049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ad23fa22-10e1-4c88-b3e8-d898ae06b93a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.158628 Aug 10 22:58:25.500610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 602/1191] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:25 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:26.524084 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:26.525089 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:26.531364 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.531849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.532293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:26.532986 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.533483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.533908 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:26.669875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:26.677709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:26.679210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:26.680366 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-34e1d31e-88f4-44ee-ab86-1508f8d08a1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.160863 Aug 10 22:58:26.680928 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 590/1192] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:26 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:27.704494 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:27.705041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:27.711277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.711768 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.712206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.712906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.713398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.713830 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.843338 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:27.851197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:27.852690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:27.853885 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-72c13e4b-273b-4c98-aa08-01eb3ea2ff95 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.153505 Aug 10 22:58:27.854453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 603/1193] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:27 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:28.878387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:28.879251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:28.885783 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.886273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.886719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.887409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.887872 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.888299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:29.020668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:29.028431 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:29.029954 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:29.031115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d463d8f3-3267-4bcf-95f0-1a55cd0bc457 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.156721 Aug 10 22:58:29.031676 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 591/1194] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:28 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:30.054844 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:30.055440 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:30.061896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:30.062283 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:30.062729 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:30.063582 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:30.064364 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:30.064880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:30.198904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:30.206827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:30.208318 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:30.209511 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ce9341f1-ccea-4f34-9822-3fd324710479 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.158542 Aug 10 22:58:30.210071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 604/1195] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:30 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:31.232699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:31.233515 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:31.240715 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:31.241693 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:31.242200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:31.243008 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:31.243530 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:31.244072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:31.391544 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:31.399974 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:31.402904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:31.404504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b4bd7f7d-3531-49f1-9db0-c7c5e188706c tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.176234 Aug 10 22:58:31.405085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 592/1196] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:31 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:32.427722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.428332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:32.435629 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.436114 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.436560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.437267 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.437746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.438173 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.577002 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:32.584863 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:32.586397 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:32.587550 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-cc5357b9-f84b-4f73-b731-c6c16f0a0188 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.163822 Aug 10 22:58:32.588116 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 605/1197] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:32 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:33.295130 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-e88ae1c9-45df-4a2f-806e-8026885e2d29 req-7042b770-bdcf-4172-a55d-cf6fdca08d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1bb3-65ab-404d-b358-0b580e3559d9", "name": "network-vif-plugged", "status": "completed", "tag": "cee28bdd-1335-44c1-9da4-99dfff6ebedf"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:33.306723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e88ae1c9-45df-4a2f-806e-8026885e2d29 req-7042b770-bdcf-4172-a55d-cf6fdca08d83 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.307229 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e88ae1c9-45df-4a2f-806e-8026885e2d29 req-7042b770-bdcf-4172-a55d-cf6fdca08d83 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.307669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e88ae1c9-45df-4a2f-806e-8026885e2d29 req-7042b770-bdcf-4172-a55d-cf6fdca08d83 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.319242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-e88ae1c9-45df-4a2f-806e-8026885e2d29 req-7042b770-bdcf-4172-a55d-cf6fdca08d83 service nova] Creating event network-vif-plugged:cee28bdd-1335-44c1-9da4-99dfff6ebedf for instance 063e1bb3-65ab-404d-b358-0b580e3559d9 on hv-cinder-83608 Aug 10 22:58:33.325102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-e88ae1c9-45df-4a2f-806e-8026885e2d29 req-7042b770-bdcf-4172-a55d-cf6fdca08d83 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033263 Aug 10 22:58:33.325740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 593/1198] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:33.611978 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:33.612592 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:33.619136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.619644 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.620085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.620779 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.621825 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.622251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.757835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:33.765828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:33.767359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:33.768508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c417fe40-257e-49a7-a2e3-41168ee52428 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.160554 Aug 10 22:58:33.769066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 606/1199] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:33 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:34.791775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:34.792418 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:34.799389 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.799887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.800328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.801030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.801517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.801951 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.932299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:34.941409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:34.942926 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:34.944085 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b1a2b5c9-b500-4227-b2bc-348113b9bfdf tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.156711 Aug 10 22:58:34.944644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 594/1200] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:34 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:35.969165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:35.970174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:35.972195 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:35.979389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.979876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.981118 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:35.981904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.982367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.982799 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:36.124760 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:36.133084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:36.134626 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:36.135795 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-86695aa9-1414-453e-8611-8134e0ec06b5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1730 microversion: 2.20 time: 0.171522 Aug 10 22:58:36.136417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 607/1201] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:35 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:37.160198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:37.160841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:37.163327 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=34 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:37.168825 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.169326 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.169783 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.170460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.170913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.171338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.175268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=87,nova_cell1:UPDATE=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:37.312392 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:37.320420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:37.321962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:37.323119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5142d5d5-3fa8-4435-90ca-e31399718087 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1717 microversion: 2.20 time: 0.166879 Aug 10 22:58:37.323847 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 595/1202] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:37 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:38.427877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:38.428378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:38.435117 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:38.435600 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:38.436034 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:38.436726 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:38.437174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:38.437628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:38.461507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-70c61736-8829-412f-a750-1c929255802d tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/ips" status: 200 len: 145 microversion: 2.1 time: 0.238312 Aug 10 22:58:38.462052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 608/1203] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:58:38 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/ips => generated 145 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:39.786814 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9bc4e11-518b-45b7-910f-50568aceec89"}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:39.789133 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:39.796537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.797024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.797507 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.798214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.798672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.799104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:40.042813 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e719f1d0-77e4-40d3-87bf-98da5db5e5fc tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259229 Aug 10 22:58:40.045377 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 596/1204] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:58:39 2022] POST /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:41.379719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:41.380227 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:41.383329 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-8a6a3895-8ab5-4bfe-bf84-a637c0200707 req-285e248b-4765-4b1b-b958-2ecc65fce51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1c87dd-de83-4565-bada-4f95a28b7f3b", "tag": "14a50685-79f1-4c68-a434-68ccadde1e8f"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:41.387134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.387627 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.388066 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.388773 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.389223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.389883 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.393806 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8a6a3895-8ab5-4bfe-bf84-a637c0200707 req-285e248b-4765-4b1b-b958-2ecc65fce51b service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.394549 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8a6a3895-8ab5-4bfe-bf84-a637c0200707 req-285e248b-4765-4b1b-b958-2ecc65fce51b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.394996 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8a6a3895-8ab5-4bfe-bf84-a637c0200707 req-285e248b-4765-4b1b-b958-2ecc65fce51b service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.406883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-8a6a3895-8ab5-4bfe-bf84-a637c0200707 req-285e248b-4765-4b1b-b958-2ecc65fce51b service nova] Creating event network-changed:14a50685-79f1-4c68-a434-68ccadde1e8f for instance de1c87dd-de83-4565-bada-4f95a28b7f3b on hv-cinder-83608 Aug 10 22:58:41.411753 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-8a6a3895-8ab5-4bfe-bf84-a637c0200707 req-285e248b-4765-4b1b-b958-2ecc65fce51b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033023 Aug 10 22:58:41.412876 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 597/1205] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:58:41.417734 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:58:41.506126 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-642a04f0-eeb3-448e-80c3-1b2fae493ac0 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "DELETE /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 204 len: 0 microversion: 2.1 time: 0.130044 Aug 10 22:58:41.506862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 609/1206] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:58:41 2022] DELETE /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:41.518853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:41.519712 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:41.526537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.527702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.528380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.529355 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.530057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.530879 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.709160 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:41.717162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8fd115e8-b748-4cbe-af48-0162cdb2da50 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.204841 Aug 10 22:58:41.717793 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 598/1207] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:41 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:42.740348 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:42.740964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:42.748316 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.748813 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.749255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.749983 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.750445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.750872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:43.134295 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:43.142104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-382cd90d-0427-4a6b-b6a6-1f0b4eddfd5d tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.406091 Aug 10 22:58:43.143363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 610/1208] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:42 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:44.164704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:44.165232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:44.171972 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.172465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.172910 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.173673 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.174156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.174584 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.392331 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:44.400670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ac111580-ae0f-43c7-a5b7-b5f0863578a6 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1568 microversion: 2.1 time: 0.239690 Aug 10 22:58:44.401436 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 599/1209] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:44 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:44.647161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-890c26db-e86e-40f6-a612-0138a670d3ad req-791e4027-fafd-4d45-95ca-18315240366c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1c87dd-de83-4565-bada-4f95a28b7f3b", "name": "network-vif-deleted", "tag": "14a50685-79f1-4c68-a434-68ccadde1e8f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:44.657996 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-890c26db-e86e-40f6-a612-0138a670d3ad req-791e4027-fafd-4d45-95ca-18315240366c service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.658516 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-890c26db-e86e-40f6-a612-0138a670d3ad req-791e4027-fafd-4d45-95ca-18315240366c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.659071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-890c26db-e86e-40f6-a612-0138a670d3ad req-791e4027-fafd-4d45-95ca-18315240366c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.663268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:44.671701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-890c26db-e86e-40f6-a612-0138a670d3ad req-791e4027-fafd-4d45-95ca-18315240366c service nova] Creating event network-vif-deleted:14a50685-79f1-4c68-a434-68ccadde1e8f for instance de1c87dd-de83-4565-bada-4f95a28b7f3b on hv-cinder-83608 Aug 10 22:58:44.676761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-890c26db-e86e-40f6-a612-0138a670d3ad req-791e4027-fafd-4d45-95ca-18315240366c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Aug 10 22:58:44.677389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 611/1210] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:45.423367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:45.423984 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:45.430873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.431293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.431736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.432446 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.433114 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.433674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.466589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.467217 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.467820 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.468273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lazy-loading 'fault' on Instance uuid de1c87dd-de83-4565-bada-4f95a28b7f3b {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:45.514598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fe2bdd1ea54f8cba4d100b26c18464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df73c10b6654d47a921aa6866d81526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:45.521490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d711a0eb-57b3-4101-b4bf-08f01e7f3e4c tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 200 len: 1179 microversion: 2.1 time: 0.102201 Aug 10 22:58:45.522060 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 600/1211] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:45 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 1179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:46.544374 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:46.545068 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] [instance: de1c87dd-de83-4565-bada-4f95a28b7f3b] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:46.552293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:46.552772 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:46.553206 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:46.553927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:46.554380 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:46.554803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:46.569141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] HTTP exception thrown: Instance de1c87dd-de83-4565-bada-4f95a28b7f3b could not be found. Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Request method failure captured: Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b HTTP/1.1 Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DZT3wuYCgvyQgF8C6Rsnr7xeRQVBHmX2FdBXorOUPR6feZvyWjncHKQv3vQgrmVYVl8o2jylXgoPAr5i-6qZccqbGzix-GG_iNltjOMZREFwD-OSqIowLVHZTcPtT5ToEdSKM3abkhX9w_Irm3_bSzrcLGTah2UjshYq-KyOY_BR8Y Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 2df73c10b6654d47a921aa6866d81526 Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-TestShelveInstance-1793807298 Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:58:46.570791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2df73c10b6654d47a921aa6866d81526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2df73c10b6654d47a921aa6866d81526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2df73c10b6654d47a921aa6866d81526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2df73c10b6654d47a921aa6866d81526"}]}] Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-TestShelveInstance-1793807298 Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 2df73c10b6654d47a921aa6866d81526 Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-TestShelveInstance-1793807298 Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-TestShelveInstance-1793807298-project Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: f5fe2bdd1ea54f8cba4d100b26c18464 Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-TestShelveInstance-1793807298-project Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance de1c87dd-de83-4565-bada-4f95a28b7f3b could not be found. Aug 10 22:58:46.572458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'de1c87dd-de83-4565-bada-4f95a28b7f3b'} Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1c87dd-de83-4565-bada-4f95a28b7f3b could not be found. Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:46.573451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1c87dd-de83-4565-bada-4f95a28b7f3b could not be found. Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1c87dd-de83-4565-bada-4f95a28b7f3b could not be found. Aug 10 22:58:46.574816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:58:46.575975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Returning 404 to user: Instance de1c87dd-de83-4565-bada-4f95a28b7f3b could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:46.575975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0b54247a-48a6-4fd3-81b3-57ff4b5fd96b tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b" status: 404 len: 111 microversion: 2.1 time: 0.033031 Aug 10 22:58:46.575975 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 612/1212] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:46 2022] GET /compute/v2.1/servers/de1c87dd-de83-4565-bada-4f95a28b7f3b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:46.729625 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-dd5fbf1b-25e0-4747-9b3c-83d249183720 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] Calling method '.version_select at 0x7fa9be9941f0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:46.758374 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-dd5fbf1b-25e0-4747-9b3c-83d249183720 tempest-TestShelveInstance-1793807298 tempest-TestShelveInstance-1793807298-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1946085716" status: 202 len: 0 microversion: 2.1 time: 0.032458 Aug 10 22:58:46.758958 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 601/1213] 10.222.0.76 () {58 vars in 1254 bytes} [Wed Aug 10 22:58:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1946085716 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:47.578960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:47.581115 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:47.587442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.587916 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.588348 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.589041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.590028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.590449 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.620105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-94a3b394-d184-4c02-9489-c89678dc4a99 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Aug 10 22:58:47.620668 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 613/1214] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:58:47 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:47.632942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:47.633464 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:47.639494 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.639983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.640420 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.641124 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.641606 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.642031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.672760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-eec9a539-0071-4026-8ae9-2e2afac23c78 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/f9bc4e11-518b-45b7-910f-50568aceec89" status: 200 len: 194 microversion: 2.1 time: 0.043878 Aug 10 22:58:47.673555 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 602/1215] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 10 22:58:47 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/f9bc4e11-518b-45b7-910f-50568aceec89 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:58:49.036870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "866476ef-98de-448c-9f8b-418d23405f45"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:49.039296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:49.046653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.047135 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.047571 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.048266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.048719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.049144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.364864 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0edd78f0-1453-4509-a63b-b76bf29e9ac9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "POST /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331815 Aug 10 22:58:49.365999 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 614/1216] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:58:49 2022] POST /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:56.948388 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.950583 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:56.957079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:56.957603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:56.958053 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:56.958750 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:56.959210 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:56.959636 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:56.989246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-0b730782-07c9-468b-989e-aa3cbfcf21a2 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045390 Aug 10 22:58:56.989833 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 603/1217] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:58:56 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:57.133588 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:57.134270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:57.140336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:57.140818 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:57.141252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:57.141966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:57.142417 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:57.142835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:57.171080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e75e61a8-43b5-4d32-b334-1965a4f63260 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/f9bc4e11-518b-45b7-910f-50568aceec89" status: 200 len: 194 microversion: 2.1 time: 0.042481 Aug 10 22:58:57.171656 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 615/1218] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 10 22:58:57 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/f9bc4e11-518b-45b7-910f-50568aceec89 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:57.181919 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:57.183087 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:57.189043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:57.189567 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:57.190005 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:57.190704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:57.191159 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:57.191590 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:57.271896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lazy-loading 'services' on Instance uuid 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:57.342078 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d5341dca-0297-46db-9d03-3cf20a6297bd tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/f9bc4e11-518b-45b7-910f-50568aceec89" status: 202 len: 0 microversion: 2.1 time: 0.163732 Aug 10 22:58:57.342538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 604/1219] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:58:57 2022] DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/f9bc4e11-518b-45b7-910f-50568aceec89 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:59.523714 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:59.524246 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:59.531109 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.531591 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.532042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.532720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.533174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.533624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.562821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7cd3ea96-f9e6-4e2a-89bb-8763accdbde7 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/866476ef-98de-448c-9f8b-418d23405f45" status: 200 len: 194 microversion: 2.1 time: 0.043124 Aug 10 22:58:59.563408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 616/1220] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 10 22:58:59 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/866476ef-98de-448c-9f8b-418d23405f45 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:59.574471 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:59.575046 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:59.581889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.582373 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.582832 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.583559 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.584009 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.584434 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.668043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lazy-loading 'services' on Instance uuid 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:59.740754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-833a0dca-60bf-4a8d-bca1-241d24138dc9 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/866476ef-98de-448c-9f8b-418d23405f45" status: 202 len: 0 microversion: 2.1 time: 0.170611 Aug 10 22:58:59.741447 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 605/1221] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:58:59 2022] DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments/866476ef-98de-448c-9f8b-418d23405f45 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:00.911874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:00.914084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:00.921093 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:00.921610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:00.922049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:00.922738 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:00.923194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:00.923623 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:00.952100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2b5f0eb8-d05d-4193-b12e-59dff2f9efce tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044246 Aug 10 22:59:00.952653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 617/1222] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:00 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:01.066263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:01.068576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:01.075686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.076175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.076618 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.077343 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.077809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.078239 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.107281 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c76f349e-68ff-463c-8883-3740233d1e1a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045729 Aug 10 22:59:01.107845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 606/1223] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:01 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:01.170972 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:01.171465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:01.177442 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.177928 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.178365 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.179052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.179509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.179933 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.205857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:59:01.283038 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-519caf5c-95e9-4347-a500-15961a301d86 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 204 len: 0 microversion: 2.1 time: 0.115654 Aug 10 22:59:01.283628 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 618/1224] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:01 2022] DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:59:01.292993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:01.293644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:01.299701 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.300184 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.300621 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.301338 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.301785 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.302212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.444251 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:01.452465 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-bc904f38-54b3-4ef0-882b-2531b59c3e4a tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1673 microversion: 2.1 time: 0.164277 Aug 10 22:59:01.453057 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 607/1225] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:01 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:02.474129 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:02.474835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:02.482297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.482787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.483269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.484010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.484466 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.484897 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.617301 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:02.624726 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-7622db1c-508f-4c42-a55b-6a124bc7b058 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1673 microversion: 2.1 time: 0.154866 Aug 10 22:59:02.625313 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 619/1226] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:02 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:03.647939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.648552 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:03.657675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.658198 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.658639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.659347 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.659803 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.660239 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.790214 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:03.798699 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6ac40419-7287-4e07-bbf7-1dfbb3b32ba3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1673 microversion: 2.1 time: 0.154554 Aug 10 22:59:03.799273 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 608/1227] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:04.820302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:04.821080 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:04.828583 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.829074 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.829538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:04.830255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.830707 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.831139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:04.900890 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405738ed219b4fdc8e3c07706a13e5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81a25303ced4ea4bf5351ec42192c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:04.909250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d513e7ff-d219-4d11-84d4-30cce8fa0640 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 200 len: 1605 microversion: 2.1 time: 0.092668 Aug 10 22:59:04.917366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 620/1228] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:04 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 1605 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:05.058629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-bfe57f1b-24a7-4394-b184-ee98909271fc req-b4237a17-0836-4f04-bb3d-94d1e7efd607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7f5fd2-0282-44a3-a894-fb4dd80b25d4", "name": "network-vif-deleted", "tag": "8e83b98a-05cd-4c91-b4b7-7f881834cbfa"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:05.071786 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-bfe57f1b-24a7-4394-b184-ee98909271fc req-b4237a17-0836-4f04-bb3d-94d1e7efd607 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.072192 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-bfe57f1b-24a7-4394-b184-ee98909271fc req-b4237a17-0836-4f04-bb3d-94d1e7efd607 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.072622 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-bfe57f1b-24a7-4394-b184-ee98909271fc req-b4237a17-0836-4f04-bb3d-94d1e7efd607 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.086522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-bfe57f1b-24a7-4394-b184-ee98909271fc req-b4237a17-0836-4f04-bb3d-94d1e7efd607 service nova] Creating event network-vif-deleted:8e83b98a-05cd-4c91-b4b7-7f881834cbfa for instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 on hv-cinder-83608 Aug 10 22:59:05.093632 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-bfe57f1b-24a7-4394-b184-ee98909271fc req-b4237a17-0836-4f04-bb3d-94d1e7efd607 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038527 Aug 10 22:59:05.094454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 609/1229] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:05.930815 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:05.931502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:05.938138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.938681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.939125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.939828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.940281 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.940706 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.955928 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] HTTP exception thrown: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Request method failure captured: Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 HTTP/1.1 Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWPbIZ58ND2bkv800UNUztf5RgwLh80MlKXOHpbEvybC__KZ6lN3sHhlT6-W4e_74I2e0O0f6tKj4RUkFk6bqcETTfV81jSuO3cxcxOl3URev3VomBq6KLtkFW7oZIRmoeLEMJPwa1aiZOHyAv2qOwySrUhdogngz8_JfMfHV_kkjE Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:59:05.957613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}] Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 405738ed219b4fdc8e3c07706a13e5a2 Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:05.959336 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '9e7f5fd2-0282-44a3-a894-fb4dd80b25d4'} Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:05.960183 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:05.961761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:05.963797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Returning 404 to user: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:05.963797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2cbe4027-244d-4396-af78-e83a00c2fef6 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 404 len: 111 microversion: 2.1 time: 0.032052 Aug 10 22:59:05.963797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 621/1230] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:05 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:05.969841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ef6afed8-0420-4819-882a-5b0cd8f0801e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '.version_select at 0x7fa9bea67af0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:05.990146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ef6afed8-0420-4819-882a-5b0cd8f0801e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123804039" status: 202 len: 0 microversion: 2.1 time: 0.024666 Aug 10 22:59:05.990986 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 610/1231] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 10 22:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123804039 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:08.903112 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:08.903614 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:08.905968 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:08.911220 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.911696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.912125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.912807 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.913254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.913698 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.928561 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] HTTP exception thrown: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Request method failure captured: Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 HTTP/1.1 Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWPbIZ58ND2bkv800UNUztf5RgwLh80MlKXOHpbEvybC__KZ6lN3sHhlT6-W4e_74I2e0O0f6tKj4RUkFk6bqcETTfV81jSuO3cxcxOl3URev3VomBq6KLtkFW7oZIRmoeLEMJPwa1aiZOHyAv2qOwySrUhdogngz8_JfMfHV_kkjE Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:59:08.930122 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}] Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 405738ed219b4fdc8e3c07706a13e5a2 Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.931842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '9e7f5fd2-0282-44a3-a894-fb4dd80b25d4'} Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:08.932618 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.933940 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.935151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Returning 404 to user: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:08.935151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1725d27d-67cc-4d44-9f50-ed4e0986550e tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 404 len: 111 microversion: 2.1 time: 0.032712 Aug 10 22:59:08.935151 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 622/1232] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:08 2022] DELETE /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:08.940912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:08.941667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:08.943550 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:08.950209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.950688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.951125 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.951823 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.952278 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.952709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.957755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:08.968852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] HTTP exception thrown: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Request method failure captured: Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 HTTP/1.1 Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWPbIZ58ND2bkv800UNUztf5RgwLh80MlKXOHpbEvybC__KZ6lN3sHhlT6-W4e_74I2e0O0f6tKj4RUkFk6bqcETTfV81jSuO3cxcxOl3URev3VomBq6KLtkFW7oZIRmoeLEMJPwa1aiZOHyAv2qOwySrUhdogngz8_JfMfHV_kkjE Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:59:08.970678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}] Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 405738ed219b4fdc8e3c07706a13e5a2 Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.972291 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '9e7f5fd2-0282-44a3-a894-fb4dd80b25d4'} Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:08.973925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. Aug 10 22:59:08.975188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:08.976297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Returning 404 to user: Instance 9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:08.976297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1ecbbfe0-08d1-4f28-83c2-8bf3ba6d2391 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4" status: 404 len: 111 microversion: 2.1 time: 0.035592 Aug 10 22:59:08.976297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 611/1233] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:08 2022] GET /compute/v2.1/servers/9e7f5fd2-0282-44a3-a894-fb4dd80b25d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:10.112829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:10.113359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:10.119929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:10.120403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:10.120842 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:10.121892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:10.122044 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:10.122438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:10.138266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] HTTP exception thrown: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Request method failure captured: Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 HTTP/1.1 Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWPbIZ58ND2bkv800UNUztf5RgwLh80MlKXOHpbEvybC__KZ6lN3sHhlT6-W4e_74I2e0O0f6tKj4RUkFk6bqcETTfV81jSuO3cxcxOl3URev3VomBq6KLtkFW7oZIRmoeLEMJPwa1aiZOHyAv2qOwySrUhdogngz8_JfMfHV_kkjE Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:59:10.139828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}] Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 405738ed219b4fdc8e3c07706a13e5a2 Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.141407 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '05b5a255-e068-46e0-8c6d-bdde4a91c933'} Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:10.142329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.143792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.145581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Returning 404 to user: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:10.145581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b14d5648-1789-41e2-bf76-19f3dc3924db tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "DELETE /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 404 len: 111 microversion: 2.1 time: 0.032341 Aug 10 22:59:10.145581 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 623/1234] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:10 2022] DELETE /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:10.150562 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:10.151203 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] [instance: 05b5a255-e068-46e0-8c6d-bdde4a91c933] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:10.160462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:10.161031 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:10.161556 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:10.162439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:10.162964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:10.163433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:10.178617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] HTTP exception thrown: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Request method failure captured: Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 HTTP/1.1 Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWPbIZ58ND2bkv800UNUztf5RgwLh80MlKXOHpbEvybC__KZ6lN3sHhlT6-W4e_74I2e0O0f6tKj4RUkFk6bqcETTfV81jSuO3cxcxOl3URev3VomBq6KLtkFW7oZIRmoeLEMJPwa1aiZOHyAv2qOwySrUhdogngz8_JfMfHV_kkjE Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 22:59:10.180138 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b81a25303ced4ea4bf5351ec42192c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b81a25303ced4ea4bf5351ec42192c13"}]}] Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: b81a25303ced4ea4bf5351ec42192c13 Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-925126331 Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 405738ed219b4fdc8e3c07706a13e5a2 Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeTestJSON-925126331-project Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.182209 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '05b5a255-e068-46e0-8c6d-bdde4a91c933'} Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:10.183143 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. Aug 10 22:59:10.184762 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 22:59:10.186170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] Returning 404 to user: Instance 05b5a255-e068-46e0-8c6d-bdde4a91c933 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:10.186170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-50e3d904-ee18-4efe-b68f-18c819265ff3 tempest-AttachVolumeTestJSON-925126331 tempest-AttachVolumeTestJSON-925126331-project] 10.222.0.76 "GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933" status: 404 len: 111 microversion: 2.1 time: 0.035712 Aug 10 22:59:10.186170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 612/1235] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:10 2022] GET /compute/v2.1/servers/05b5a255-e068-46e0-8c6d-bdde4a91c933 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:14.467325 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e0ac09f6-7b75-43d7-8e8a-38eded746d49 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Action: 'create', calling method: .version_select at 0x7fa9be739820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1669921806", "metadata": {"Type": "work"}}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:14.764884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e0ac09f6-7b75-43d7-8e8a-38eded746d49 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.412559 Aug 10 22:59:14.765529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 624/1236] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 10 22:59:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 22:59:14.778865 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-fc025e93-ba6a-4e0b-b286-c634c97b1331 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Calling method '.version_select at 0x7fa9be6a8790>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:14.835626 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-fc025e93-ba6a-4e0b-b286-c634c97b1331 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a" status: 200 len: 353 microversion: 2.1 time: 0.061953 Aug 10 22:59:14.836379 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 613/1237] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:59:14 2022] GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:15.850528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-af8f1802-f9e1-4536-b97a-dc44ed934876 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Calling method '.version_select at 0x7fa9c2faa8b0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:15.901723 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-af8f1802-f9e1-4536-b97a-dc44ed934876 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a" status: 200 len: 354 microversion: 2.1 time: 0.055408 Aug 10 22:59:15.902366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 625/1238] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:59:15 2022] GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:15.915002 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e0335691-0c4f-447f-a3b9-3f19d886026c tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Calling method '.version_select at 0x7fa9be8540d0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:15.963521 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e0335691-0c4f-447f-a3b9-3f19d886026c tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a" status: 200 len: 354 microversion: 2.1 time: 0.052892 Aug 10 22:59:15.964091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 614/1239] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:59:15 2022] GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:15.981717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-edcd1549-7e19-41ff-80d7-3ef6eb318640 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Calling method '.version_select at 0x7fa9be8c2e50>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:16.043484 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-edcd1549-7e19-41ff-80d7-3ef6eb318640 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a" status: 202 len: 0 microversion: 2.1 time: 0.065482 Aug 10 22:59:16.044049 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 626/1240] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:59:15 2022] DELETE /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:59:16.052815 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-617e5b10-0457-4398-9bab-7167b828c986 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Calling method '.version_select at 0x7fa9be842160>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:16.101356 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-617e5b10-0457-4398-9bab-7167b828c986 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a" status: 200 len: 353 microversion: 2.1 time: 0.052428 Aug 10 22:59:16.102063 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 615/1241] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:59:16 2022] GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:17.116023 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0ab27db4-77cf-44eb-8407-64b72ed03147 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Calling method '.version_select at 0x7fa9be6ddd30>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:17.145103 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-0ab27db4-77cf-44eb-8407-64b72ed03147 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] HTTP exception thrown: Volume ff40bf3a-e55d-4463-8848-e7eee4ea640a could not be found. Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0ab27db4-77cf-44eb-8407-64b72ed03147 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Request method failure captured: Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a HTTP/1.1 Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DhChTOwH8L5c1c8hO2i-zrHA2BHhWMSErjjBEIQ9G1Of67l4xAtwB0u4peFX_5pdi5NthEdTOFZ40tdebvSHiKCtipsGSdXRbbmzSVJc3B8_JLom_hYh3DpwMPfdh9F-smUnx-BHrWKQogkBLBjJpp5d-DoFAwEKxo91DLEFUK_QzY Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 762d90c0aed04f1583a5f96c13f2c86e Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesGetTestJSON-744910279 Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:59:17.147092 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/762d90c0aed04f1583a5f96c13f2c86e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/762d90c0aed04f1583a5f96c13f2c86e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_762d90c0aed04f1583a5f96c13f2c86e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/762d90c0aed04f1583a5f96c13f2c86e"}]}] Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesGetTestJSON-744910279 Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 762d90c0aed04f1583a5f96c13f2c86e Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesGetTestJSON-744910279 Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesGetTestJSON-744910279-project Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: be5c322583694f2aa32df288bd0ec14d Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesGetTestJSON-744910279-project Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Volume ff40bf3a-e55d-4463-8848-e7eee4ea640a could not be found. Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'ff40bf3a-e55d-4463-8848-e7eee4ea640a'} Aug 10 22:59:17.148754 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff40bf3a-e55d-4463-8848-e7eee4ea640a could not be found. (HTTP 404) (Request-ID: req-4852ac5b-4d60-498a-89a2-63ac37f893a0) Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:17.152959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:59:17.154554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff40bf3a-e55d-4463-8848-e7eee4ea640a could not be found. Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 22:59:17.156433 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff40bf3a-e55d-4463-8848-e7eee4ea640a could not be found. Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff40bf3a-e55d-4463-8848-e7eee4ea640a could not be found. Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0ab27db4-77cf-44eb-8407-64b72ed03147 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] Returning 404 to user: Volume ff40bf3a-e55d-4463-8848-e7eee4ea640a could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0ab27db4-77cf-44eb-8407-64b72ed03147 tempest-VolumesGetTestJSON-744910279 tempest-VolumesGetTestJSON-744910279-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a" status: 404 len: 109 microversion: 2.1 time: 0.037662 Aug 10 22:59:17.158027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 627/1242] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 22:59:17 2022] GET /compute/v2.1/os-volumes/ff40bf3a-e55d-4463-8848-e7eee4ea640a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:42.250116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:42.250861 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:42.254834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:42.255397 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:42.262280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.262839 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.263363 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.264128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.264655 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.265167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.290212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-93f0e7ce-5030-4481-91e0-849ffbd0500f tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/ips" status: 200 len: 149 microversion: 2.1 time: 0.041498 Aug 10 22:59:42.290802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 616/1243] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 22:59:42 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:43.646384 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:43.647120 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:43.652896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f1c11c8-3915-482c-ad2c-31b4403374d5"}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:43.655318 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:43.662702 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:43.663176 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:43.664253 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:43.664924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:43.665409 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:43.665831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:43.934359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4177215e-c6fd-4b7c-adab-4e85f91f2892 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "POST /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289236 Aug 10 22:59:43.938452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 628/1244] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 10 22:59:43 2022] POST /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:51.576745 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:51.577386 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:51.583662 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.584144 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.584587 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.585299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.585761 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.586190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.666010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lazy-loading 'services' on Instance uuid 43c99b7b-2f26-480c-86d9-a0d06ae6202c {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:51.741811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-08696bf2-42e0-4f3f-8510-9e451f4d50d2 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments/0f1c11c8-3915-482c-ad2c-31b4403374d5" status: 202 len: 0 microversion: 2.1 time: 0.168712 Aug 10 22:59:51.742413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 617/1245] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 10 22:59:51 2022] DELETE /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments/0f1c11c8-3915-482c-ad2c-31b4403374d5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:51.753157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:51.756130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:51.764013 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.764508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.764947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.765677 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.766130 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.766554 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.804010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d5a9cf8b-7e16-4a97-9bd0-09e6045a12a1 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055481 Aug 10 22:59:51.804661 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 629/1246] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:51 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:59:52.817594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.819845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:52.826353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.826840 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.827369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.828188 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.828584 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.828917 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.861875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6a7477c1-5ad6-4e50-b4d8-0b8e2b45abc0 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049347 Aug 10 22:59:52.862548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 618/1247] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:52 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:53.874132 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:53.876270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:53.882752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:53.883225 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:53.883657 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:53.884345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:53.884789 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:53.885792 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:53.913703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ae6b81a6-c4ab-479c-9e20-e63a8e901a10 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043731 Aug 10 22:59:53.914254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 630/1248] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:53 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:53.974913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:53.975430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:53.982315 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:53.982801 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:53.983243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:53.983939 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:53.984399 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:53.984835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.010576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:59:54.099457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e46cbf55-29b9-4164-b9bd-cf4600e9f277 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 204 len: 0 microversion: 2.1 time: 0.127764 Aug 10 22:59:54.100044 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 619/1249] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:53 2022] DELETE /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:59:54.108639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.109254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.115318 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.115798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.116231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.116921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.117409 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.117831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.251473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:54.258884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-fa3b6864-0737-4835-b46c-f9408238537e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1680 microversion: 2.1 time: 0.154586 Aug 10 22:59:54.259456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 631/1250] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:54 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:54.402622 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.404962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.414299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.414997 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.415440 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.416151 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.416723 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.417478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.453688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c5ff735a-bd1c-4390-aa0a-d780cdad981a tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055764 Aug 10 22:59:54.454183 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 620/1251] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 10 22:59:54 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:54.514519 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.515020 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.520869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.521386 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.521821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.522543 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.522999 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.523424 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.548254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Going to try to terminate instance {{(pid=132540) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:59:54.623663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-00a73e24-e638-4967-b671-029eaca1832b tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 204 len: 0 microversion: 2.20 time: 0.113258 Aug 10 22:59:54.624236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 632/1252] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 10 22:59:54 2022] DELETE /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 22:59:54.632473 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.633162 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.639760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.640243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.640679 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.641408 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.641884 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.642288 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.778020 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:54.788645 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:54.790370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:54.792331 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-45689239-6fb6-4811-bed4-1f52b2e18f1e tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.163654 Aug 10 22:59:54.793077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 621/1253] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:59:54 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:59:55.282125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:55.282828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:55.289232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.289753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.290193 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.290937 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.292053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.292728 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.427138 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:55.436438 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-214abdcb-0fd4-4d3d-bda0-07a7983edf63 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1680 microversion: 2.1 time: 0.158872 Aug 10 22:59:55.437021 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 633/1254] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:55 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:55.816718 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:55.817268 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:55.824190 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.824697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.825118 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.825851 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.826307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.826733 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.958280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:55.966929 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:55.968417 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:55.969600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-757a3cae-4969-4521-ad63-2965b2c92b13 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.156926 Aug 10 22:59:55.970159 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 622/1255] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:59:55 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:59:56.457727 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:56.458376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:56.465579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.466068 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.466517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:56.467215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.467678 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.468106 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:56.600212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:56.608426 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-45c2c671-9744-42d1-ad38-ddfe52fdfe53 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1680 microversion: 2.1 time: 0.154520 Aug 10 22:59:56.609006 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 634/1256] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:56 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:56.996651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:56.997259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:57.003835 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.004321 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.004757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.005496 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.005950 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.006370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.137309 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:57.145102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:57.146621 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:57.147768 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1c3fa4e7-9528-4115-8daf-3e9e613288f9 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.158952 Aug 10 22:59:57.148323 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 623/1257] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:59:56 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:59:57.630333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:57.630947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:57.638084 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.638567 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.639002 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.639691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.640141 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.640564 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.768241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:57.775719 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-b465fe7b-be9b-433e-9204-7c1a2bf6d989 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1680 microversion: 2.1 time: 0.149204 Aug 10 22:59:57.777071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 635/1258] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:57 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:58.171867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:58.172432 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:58.178675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.179166 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.179604 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.180302 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.180755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.181223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.430912 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:58.439372 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:58.441132 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:58.442510 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d5b0c0ed-d24a-431d-8959-e6f268666503 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1723 microversion: 2.20 time: 0.274614 Aug 10 22:59:58.457504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 624/1259] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:59:58 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:59:58.656016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-a0527ef2-6cd2-466e-bd51-55bf78621d39 req-ac092084-072b-4eb2-8482-e4d33d8d6349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c99b7b-2f26-480c-86d9-a0d06ae6202c", "name": "network-vif-deleted", "tag": "606da499-b569-4803-9ab1-b21cfc0c7aff"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:58.664921 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-a0527ef2-6cd2-466e-bd51-55bf78621d39 req-ac092084-072b-4eb2-8482-e4d33d8d6349 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.665434 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-a0527ef2-6cd2-466e-bd51-55bf78621d39 req-ac092084-072b-4eb2-8482-e4d33d8d6349 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.665857 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-a0527ef2-6cd2-466e-bd51-55bf78621d39 req-ac092084-072b-4eb2-8482-e4d33d8d6349 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.678009 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-a0527ef2-6cd2-466e-bd51-55bf78621d39 req-ac092084-072b-4eb2-8482-e4d33d8d6349 service nova] Creating event network-vif-deleted:606da499-b569-4803-9ab1-b21cfc0c7aff for instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c on hv-cinder-83608 Aug 10 22:59:58.684469 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-a0527ef2-6cd2-466e-bd51-55bf78621d39 req-ac092084-072b-4eb2-8482-e4d33d8d6349 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033880 Aug 10 22:59:58.686784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 636/1260] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:58.808558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:58.809964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:58.830740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.832439 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.833659 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.834706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.835387 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.836163 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.878613 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.880530 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.881145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.881961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lazy-loading 'fault' on Instance uuid 43c99b7b-2f26-480c-86d9-a0d06ae6202c {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:58.939310 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22fc66a1d14fa983463331de110258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c0b68704e04cdd84f27922e4da5e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:58.947402 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8a490813-3538-44e5-a8e7-61ffeced27a3 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 200 len: 1331 microversion: 2.1 time: 0.153049 Aug 10 22:59:58.948589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 625/1261] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:58 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:59.273829 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-0d040c0f-9d54-4f05-8bc7-686a2a687401 req-9c591913-f01c-4a13-abb3-e67914797ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e1bb3-65ab-404d-b358-0b580e3559d9", "name": "network-vif-deleted", "tag": "cee28bdd-1335-44c1-9da4-99dfff6ebedf"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:59.284465 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-0d040c0f-9d54-4f05-8bc7-686a2a687401 req-9c591913-f01c-4a13-abb3-e67914797ab3 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.285202 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-0d040c0f-9d54-4f05-8bc7-686a2a687401 req-9c591913-f01c-4a13-abb3-e67914797ab3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.285991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-0d040c0f-9d54-4f05-8bc7-686a2a687401 req-9c591913-f01c-4a13-abb3-e67914797ab3 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.306025 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-0d040c0f-9d54-4f05-8bc7-686a2a687401 req-9c591913-f01c-4a13-abb3-e67914797ab3 service nova] Creating event network-vif-deleted:cee28bdd-1335-44c1-9da4-99dfff6ebedf for instance 063e1bb3-65ab-404d-b358-0b580e3559d9 on hv-cinder-83608 Aug 10 22:59:59.312289 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-0d040c0f-9d54-4f05-8bc7-686a2a687401 req-9c591913-f01c-4a13-abb3-e67914797ab3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042288 Aug 10 22:59:59.317892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 637/1262] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:59.468032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:59.468650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:59.479675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.480570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.481218 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.482189 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.482836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.483454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.523811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.524330 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.524800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.525193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.objects.instance [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lazy-loading 'fault' on Instance uuid 063e1bb3-65ab-404d-b358-0b580e3559d9 {{(pid=132541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:59.569539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:59.578993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:59.580538 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12e6b0b71ecb4825aeab6735eb44e63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e2567825f44d938dfbf7e043015367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:59.581771 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6c99a86a-1c07-4138-a968-bbfd9630ab6f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 200 len: 1371 microversion: 2.20 time: 0.118058 Aug 10 22:59:59.582367 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 626/1263] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 22:59:59 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:59:59.972182 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:59.972889 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:59.979876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.980362 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.980801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.981528 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.981982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.982401 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.996578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c HTTP/1.1 Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 22:59:59.998272 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 22:59:59.999880 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '43c99b7b-2f26-480c-86d9-a0d06ae6202c'} Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:00.000797 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:00.002453 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.003865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:00.003865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a4c48ccd-8428-4e29-9ff4-8156f2c6b20a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 404 len: 111 microversion: 2.1 time: 0.032579 Aug 10 23:00:00.003865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 638/1264] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:59 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:00.008390 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2d46536f-494e-4984-8341-0906b16fa30e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '.version_select at 0x7fa9be7a4c10>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:00.027522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2d46536f-494e-4984-8341-0906b16fa30e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676143079" status: 202 len: 0 microversion: 2.1 time: 0.022737 Aug 10 23:00:00.028102 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 627/1265] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 10 23:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676143079 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:00:00.608696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:00.609502 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:00.615866 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.616524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.617121 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.617911 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.618448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.618942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.634053 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] HTTP exception thrown: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Request method failure captured: Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 HTTP/1.1 Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWElqe5EPxwZoSSPP7pZuUmZm46PCO9ULgfbGVW9GeSXjzEvu9BcsCWt5DI73wYVM76VMYD4GDaic1sbdbBw5Ny-hJgv2zrGMFTOQ-eMV7hyWIig7614OTlDLrEYYcCdDf_-h1tkM_yld8WbBihqyBXfWLk4xI0V4LLJYT426euFHM Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:00.635982 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a4e2567825f44d938dfbf7e043015367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}] Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 12e6b0b71ecb4825aeab6735eb44e63e Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:00.637525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '063e1bb3-65ab-404d-b358-0b580e3559d9'} Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:00.638474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:00.639865 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:00.640990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Returning 404 to user: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:00.640990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f85a8907-5361-4ca6-b768-e60c3c88cf0d tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 404 len: 111 microversion: 2.20 time: 0.035519 Aug 10 23:00:00.640990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 639/1266] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:00 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:00:00.646807 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-20b85202-4a31-4f7c-af16-ac86f64cabf5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '.version_select at 0x7fa9be994160>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:00.670116 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-20b85202-4a31-4f7c-af16-ac86f64cabf5 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705297778" status: 204 len: 0 microversion: 2.20 time: 0.027186 Aug 10 23:00:00.670828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 628/1267] 10.222.0.76 () {60 vars in 1259 bytes} [Wed Aug 10 23:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705297778 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:00:01.814732 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:01.815212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:01.821580 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.822058 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.822622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.824204 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.825341 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.825798 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.841224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c HTTP/1.1 Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:01.842827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.844411 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '43c99b7b-2f26-480c-86d9-a0d06ae6202c'} Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:01.845327 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.846787 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.848231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:01.848231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-025979ec-820d-40c5-98e0-76a8e29a0744 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 404 len: 111 microversion: 2.1 time: 0.033363 Aug 10 23:00:01.848231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 640/1268] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:01 2022] DELETE /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:01.853414 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:01.854091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 43c99b7b-2f26-480c-86d9-a0d06ae6202c] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:01.860228 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.860714 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.861154 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.861911 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.862369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.862800 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.876852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c HTTP/1.1 Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:01.878504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.880117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '43c99b7b-2f26-480c-86d9-a0d06ae6202c'} Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:01.881039 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. Aug 10 23:00:01.882571 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:01.883881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance 43c99b7b-2f26-480c-86d9-a0d06ae6202c could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:01.883881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-456b284c-d15f-4ea0-bb8b-336e5c18c518 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c" status: 404 len: 111 microversion: 2.1 time: 0.030932 Aug 10 23:00:01.883881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 629/1269] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:01 2022] GET /compute/v2.1/servers/43c99b7b-2f26-480c-86d9-a0d06ae6202c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:02.468679 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:02.469185 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:02.475363 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.475843 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.476322 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.477002 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.477492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.477917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.494956 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] HTTP exception thrown: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Request method failure captured: Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 HTTP/1.1 Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWElqe5EPxwZoSSPP7pZuUmZm46PCO9ULgfbGVW9GeSXjzEvu9BcsCWt5DI73wYVM76VMYD4GDaic1sbdbBw5Ny-hJgv2zrGMFTOQ-eMV7hyWIig7614OTlDLrEYYcCdDf_-h1tkM_yld8WbBihqyBXfWLk4xI0V4LLJYT426euFHM Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:02.496855 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a4e2567825f44d938dfbf7e043015367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}] Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 12e6b0b71ecb4825aeab6735eb44e63e Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.498487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '063e1bb3-65ab-404d-b358-0b580e3559d9'} Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:02.499319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.500836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.502368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Returning 404 to user: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:02.502368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c96532ad-a697-4530-8c9c-32200baf1c03 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 404 len: 111 microversion: 2.20 time: 0.033641 Aug 10 23:00:02.502368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 641/1270] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 10 23:00:02 2022] DELETE /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:00:02.506731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:02.507346 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 063e1bb3-65ab-404d-b358-0b580e3559d9] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:02.513651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.514131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.514573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.515269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.515724 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.516152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.530651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] HTTP exception thrown: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Request method failure captured: Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 HTTP/1.1 Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWElqe5EPxwZoSSPP7pZuUmZm46PCO9ULgfbGVW9GeSXjzEvu9BcsCWt5DI73wYVM76VMYD4GDaic1sbdbBw5Ny-hJgv2zrGMFTOQ-eMV7hyWIig7614OTlDLrEYYcCdDf_-h1tkM_yld8WbBihqyBXfWLk4xI0V4LLJYT426euFHM Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:02.532090 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a4e2567825f44d938dfbf7e043015367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}] Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 12e6b0b71ecb4825aeab6735eb44e63e Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.533875 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '063e1bb3-65ab-404d-b358-0b580e3559d9'} Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:02.534720 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. Aug 10 23:00:02.536035 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:02.537451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Returning 404 to user: Instance 063e1bb3-65ab-404d-b358-0b580e3559d9 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:02.537451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ae25c7a3-d656-4abb-810e-93c5279ca3ac tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9" status: 404 len: 111 microversion: 2.20 time: 0.030563 Aug 10 23:00:02.537451 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 630/1271] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:02 2022] GET /compute/v2.1/servers/063e1bb3-65ab-404d-b358-0b580e3559d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:00:03.021264 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.021836 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.028046 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.028523 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.028961 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.029674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.030127 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.030550 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.044905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d HTTP/1.1 Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:03.046572 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.048356 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '27093fe9-e428-4e9d-b997-dc252de8ae3d'} Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:03.052339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.053874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.055429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:03.055429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8918a405-8be4-4ca2-9b30-573470c25d4a tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 404 len: 111 microversion: 2.1 time: 0.030531 Aug 10 23:00:03.055429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 642/1272] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:03 2022] DELETE /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:00:03.056416 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.057744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: 27093fe9-e428-4e9d-b997-dc252de8ae3d] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.064316 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.064802 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.065242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.065968 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.066422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.066849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.080186 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d HTTP/1.1 Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:03.081731 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.083337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '27093fe9-e428-4e9d-b997-dc252de8ae3d'} Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:03.084242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. Aug 10 23:00:03.085930 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.087494 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance 27093fe9-e428-4e9d-b997-dc252de8ae3d could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:03.087494 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-8283c73f-0fdc-4a5b-ba4f-96694e56a498 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d" status: 404 len: 111 microversion: 2.1 time: 0.030437 Aug 10 23:00:03.087494 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 631/1273] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:03 2022] GET /compute/v2.1/servers/27093fe9-e428-4e9d-b997-dc252de8ae3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:00:03.091777 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.092275 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.098210 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.098691 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.099124 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.099849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.100307 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.100740 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.114701 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 HTTP/1.1 Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:03.116237 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.117862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5'} Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:03.118784 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.121269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.122852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:03.122852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-12380eec-867c-485d-830e-d265bbf9e01b tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 404 len: 111 microversion: 2.1 time: 0.029940 Aug 10 23:00:03.122852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 643/1274] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:03 2022] DELETE /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:03.128079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.128692 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.134598 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.135184 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.135698 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.136395 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.136849 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.137333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.152639 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 HTTP/1.1 Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:03.154167 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.155739 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': 'e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5'} Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:03.156630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. Aug 10 23:00:03.158121 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.159668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:03.159668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-be14c3f6-5c83-4a85-9e7f-6fa5b7117f5e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5" status: 404 len: 111 microversion: 2.1 time: 0.031381 Aug 10 23:00:03.159668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 632/1275] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:03 2022] GET /compute/v2.1/servers/e34f2eeb-4ef9-4a79-8ecd-d6b6e8affba5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:03.672540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.673039 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.678917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.679390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.679827 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.680519 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.680970 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.681429 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.694503 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] HTTP exception thrown: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Request method failure captured: Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 HTTP/1.1 Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWElqe5EPxwZoSSPP7pZuUmZm46PCO9ULgfbGVW9GeSXjzEvu9BcsCWt5DI73wYVM76VMYD4GDaic1sbdbBw5Ny-hJgv2zrGMFTOQ-eMV7hyWIig7614OTlDLrEYYcCdDf_-h1tkM_yld8WbBihqyBXfWLk4xI0V4LLJYT426euFHM Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:03.696043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a4e2567825f44d938dfbf7e043015367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}] Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: 12e6b0b71ecb4825aeab6735eb44e63e Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.697762 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0'} Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:03.699643 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.701331 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.702858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Returning 404 to user: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:03.702858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-67141f58-ef41-4387-85c1-6223fb7b04d3 tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 404 len: 111 microversion: 2.20 time: 0.028807 Aug 10 23:00:03.702858 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 644/1276] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 10 23:00:03 2022] DELETE /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:00:03.708096 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.708703 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] [instance: 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.715145 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.715944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.716391 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.717115 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.717589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.718016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.731533 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] HTTP exception thrown: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Request method failure captured: Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 HTTP/1.1 Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWElqe5EPxwZoSSPP7pZuUmZm46PCO9ULgfbGVW9GeSXjzEvu9BcsCWt5DI73wYVM76VMYD4GDaic1sbdbBw5Ny-hJgv2zrGMFTOQ-eMV7hyWIig7614OTlDLrEYYcCdDf_-h1tkM_yld8WbBihqyBXfWLk4xI0V4LLJYT426euFHM Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:03.733049 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a4e2567825f44d938dfbf7e043015367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a4e2567825f44d938dfbf7e043015367"}]}] Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: a4e2567825f44d938dfbf7e043015367 Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490144863 Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: 12e6b0b71ecb4825aeab6735eb44e63e Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490144863-project Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.734784 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0'} Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:03.735722 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. Aug 10 23:00:03.737225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:03.738586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] Returning 404 to user: Instance 4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:03.738586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-806431db-31cd-4a66-946f-6a075876cb9f tempest-AttachVolumeShelveTestJSON-1490144863 tempest-AttachVolumeShelveTestJSON-1490144863-project] 10.222.0.76 "GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0" status: 404 len: 111 microversion: 2.20 time: 0.030235 Aug 10 23:00:03.738586 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 633/1277] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:03 2022] GET /compute/v2.1/servers/4621b7b9-4f3f-4ac3-ab06-d4ccf95869c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:00:04.297598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:04.298165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:04.304805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.305408 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.305935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.306700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.307224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.307649 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.321224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a HTTP/1.1 Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:04.322803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.324941 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'cecaf930-d7cc-4ee7-b096-6f206dc50e7a'} Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:04.325788 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.327052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.328610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:04.328610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4a02658c-c3e6-4ebe-89ad-a96ff575d119 tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "DELETE /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 404 len: 111 microversion: 2.1 time: 0.031105 Aug 10 23:00:04.328610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 645/1278] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:04 2022] DELETE /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:04.333405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:04.334023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] [instance: cecaf930-d7cc-4ee7-b096-6f206dc50e7a] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:04.341055 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.341574 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.342016 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.342719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.343171 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.343594 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.357073 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] HTTP exception thrown: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Request method failure captured: Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a HTTP/1.1 Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9DWNIsm21Kde_MQtIbr7bbZX2RsYi_kemuN_LlFo43FcDgDcO_WVcbapHE-EmESQHBzosTCveGNMoPIRV84rMOCCaqWU9t17yexCo3s5SNKCltAmU-oGsKqRsgpQawvVHK3yNOmL0bDGpBgpz5-34I89JTdg1TeUhFJzHCmuDQ-Hkoc Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:04.358629 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_89c0b68704e04cdd84f27922e4da5e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/89c0b68704e04cdd84f27922e4da5e5d"}]}] Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 89c0b68704e04cdd84f27922e4da5e5d Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-195885339 Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: da22fc66a1d14fa983463331de110258 Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-AttachVolumeNegativeTest-195885339-project Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.360152 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': 'cecaf930-d7cc-4ee7-b096-6f206dc50e7a'} Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:04.361328 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. Aug 10 23:00:04.362810 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:04.364247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] Returning 404 to user: Instance cecaf930-d7cc-4ee7-b096-6f206dc50e7a could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:04.364247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b70973dc-6051-491b-bd89-fa5e4be9407e tempest-AttachVolumeNegativeTest-195885339 tempest-AttachVolumeNegativeTest-195885339-project] 10.222.0.76 "GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a" status: 404 len: 111 microversion: 2.1 time: 0.030461 Aug 10 23:00:04.364247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 634/1279] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:04 2022] GET /compute/v2.1/servers/cecaf930-d7cc-4ee7-b096-6f206dc50e7a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:09.071736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6c714b30-d8a2-4ebd-ab58-a1e44f68ccf9 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Action: 'create', calling method: .version_select at 0x7fa9c0513a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2035650791", "metadata": {"Type": "work"}}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6c714b30-d8a2-4ebd-ab58-a1e44f68ccf9 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Request method failure captured: Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 122 Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9Dh40IhgfHvk_SNJjMj8vxtOE-KJdO0otFdxhSTBIQAiwHHzBRGnMGHujigE9_lKw-fxHplqd8TlSxG3MZ-6vXwtZoUeAW_8HaDj4zGK1cGw277m7fBG95IDEu7szDiHVK0y_yolLLDPAM9saSsupl1g6v_940Osn7ei4UDr5GkmSig Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:09.096478 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8ad2ca141f324bad88198144f6273f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}] Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: f667c2b27c1f4632968c874801c01bec Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2035650791", "metadata": {"Type": "work"}}} Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: Aug 10 23:00:09.098223 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2035650791', 'metadata': {'Type': 'work'}}}} Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:09.099491 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:00:09.101245 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:00:09.102615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:00:09.102615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.102615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6c714b30-d8a2-4ebd-ab58-a1e44f68ccf9 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:09.102615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6c714b30-d8a2-4ebd-ab58-a1e44f68ccf9 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179629 Aug 10 23:00:09.102615 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 646/1280] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 10 23:00:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:00:09.108430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-90309cbe-2ae2-4f02-b7e0-1c1704773d63 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Action: 'create', calling method: .version_select at 0x7fa9bead4e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-39072415", "metadata": {"Type": "work"}}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-90309cbe-2ae2-4f02-b7e0-1c1704773d63 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Request method failure captured: Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 118 Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9Dh40IhgfHvk_SNJjMj8vxtOE-KJdO0otFdxhSTBIQAiwHHzBRGnMGHujigE9_lKw-fxHplqd8TlSxG3MZ-6vXwtZoUeAW_8HaDj4zGK1cGw277m7fBG95IDEu7szDiHVK0y_yolLLDPAM9saSsupl1g6v_940Osn7ei4UDr5GkmSig Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:09.113504 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8ad2ca141f324bad88198144f6273f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}] Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: f667c2b27c1f4632968c874801c01bec Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-39072415", "metadata": {"Type": "work"}}} Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: Aug 10 23:00:09.115170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-39072415', 'metadata': {'Type': 'work'}}}} Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi '0' Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:09.116375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:00:09.118082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:00:09.119479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:00:09.119479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.119479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-90309cbe-2ae2-4f02-b7e0-1c1704773d63 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:09.119479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-90309cbe-2ae2-4f02-b7e0-1c1704773d63 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010628 Aug 10 23:00:09.119479 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 635/1281] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 10 23:00:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:00:09.130187 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3420dc98-e8ca-46d6-8e99-e6c774f342df tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Action: 'create', calling method: .version_select at 0x7fa9c2f5f040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-988277271", "metadata": {"Type": "work"}}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3420dc98-e8ca-46d6-8e99-e6c774f342df tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Request method failure captured: Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 118 Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9Dh40IhgfHvk_SNJjMj8vxtOE-KJdO0otFdxhSTBIQAiwHHzBRGnMGHujigE9_lKw-fxHplqd8TlSxG3MZ-6vXwtZoUeAW_8HaDj4zGK1cGw277m7fBG95IDEu7szDiHVK0y_yolLLDPAM9saSsupl1g6v_940Osn7ei4UDr5GkmSig Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:09.133935 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8ad2ca141f324bad88198144f6273f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}] Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: f667c2b27c1f4632968c874801c01bec Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-988277271", "metadata": {"Type": "work"}}} Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: Aug 10 23:00:09.135332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-988277271', 'metadata': {'Type': 'work'}}}} Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi '' Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:09.136869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:00:09.138919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:00:09.140236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:00:09.140236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.140236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-3420dc98-e8ca-46d6-8e99-e6c774f342df tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:09.140236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-3420dc98-e8ca-46d6-8e99-e6c774f342df tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009167 Aug 10 23:00:09.140236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 647/1282] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 10 23:00:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:00:09.146478 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1e8cd3d6-f382-469c-8852-66281632e6a8 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Calling method '.version_select at 0x7fa9be8548b0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:09.178541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-1e8cd3d6-f382-469c-8852-66281632e6a8 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] HTTP exception thrown: Volume tempest-invalid-1026190303 could not be found. Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1e8cd3d6-f382-469c-8852-66281632e6a8 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Request method failure captured: Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1026190303 HTTP/1.1 Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9Dh40IhgfHvk_SNJjMj8vxtOE-KJdO0otFdxhSTBIQAiwHHzBRGnMGHujigE9_lKw-fxHplqd8TlSxG3MZ-6vXwtZoUeAW_8HaDj4zGK1cGw277m7fBG95IDEu7szDiHVK0y_yolLLDPAM9saSsupl1g6v_940Osn7ei4UDr5GkmSig Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:09.181732 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8ad2ca141f324bad88198144f6273f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}] Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: f667c2b27c1f4632968c874801c01bec Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Volume tempest-invalid-1026190303 could not be found. Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': 'tempest-invalid-1026190303'} Aug 10 23:00:09.184225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1026190303 could not be found. (HTTP 404) (Request-ID: req-d48f5eca-2b47-4c76-b295-77473300a1cb) Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.185393 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:00:09.188385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1026190303 could not be found. Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:09.191880 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1026190303 could not be found. Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1026190303 could not be found. Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-1e8cd3d6-f382-469c-8852-66281632e6a8 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Returning 404 to user: Volume tempest-invalid-1026190303 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-1e8cd3d6-f382-469c-8852-66281632e6a8 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1026190303" status: 404 len: 99 microversion: 2.1 time: 0.046034 Aug 10 23:00:09.193728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 636/1283] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 10 23:00:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1026190303 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:00:09.201544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d61a23aa-a9a6-40b0-8b9e-9e1c8ed9dd37 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005105 Aug 10 23:00:09.202071 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 648/1284] 10.222.0.76 () {58 vars in 1140 bytes} [Wed Aug 10 23:00:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 23:00:09.211589 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-92f897bd-4ab9-4acd-a2ce-462a1f84a466 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003859 Aug 10 23:00:09.212226 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 637/1285] 10.222.0.76 () {58 vars in 1137 bytes} [Wed Aug 10 23:00:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 23:00:09.223366 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4353d465-271f-4233-9446-abd63596ebe0 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Calling method '.version_select at 0x7fa9c2dcd820>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:09.262977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-4353d465-271f-4233-9446-abd63596ebe0 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] HTTP exception thrown: Volume e184a557-eb14-441d-b0bf-7dc666231933 could not be found. Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4353d465-271f-4233-9446-abd63596ebe0 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Request method failure captured: Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/os-volumes/e184a557-eb14-441d-b0bf-7dc666231933 HTTP/1.1 Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9Dh40IhgfHvk_SNJjMj8vxtOE-KJdO0otFdxhSTBIQAiwHHzBRGnMGHujigE9_lKw-fxHplqd8TlSxG3MZ-6vXwtZoUeAW_8HaDj4zGK1cGw277m7fBG95IDEu7szDiHVK0y_yolLLDPAM9saSsupl1g6v_940Osn7ei4UDr5GkmSig Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:00:09.265270 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8ad2ca141f324bad88198144f6273f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}] Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: f667c2b27c1f4632968c874801c01bec Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Volume e184a557-eb14-441d-b0bf-7dc666231933 could not be found. Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'e184a557-eb14-441d-b0bf-7dc666231933'} Aug 10 23:00:09.267042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e184a557-eb14-441d-b0bf-7dc666231933 could not be found. (HTTP 404) (Request-ID: req-f4c1ed6f-5d0d-4020-b488-7b00d3947628) Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.268079 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:00:09.269947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e184a557-eb14-441d-b0bf-7dc666231933 could not be found. Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:00:09.271377 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e184a557-eb14-441d-b0bf-7dc666231933 could not be found. Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e184a557-eb14-441d-b0bf-7dc666231933 could not be found. Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4353d465-271f-4233-9446-abd63596ebe0 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Returning 404 to user: Volume e184a557-eb14-441d-b0bf-7dc666231933 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4353d465-271f-4233-9446-abd63596ebe0 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/e184a557-eb14-441d-b0bf-7dc666231933" status: 404 len: 109 microversion: 2.1 time: 0.048578 Aug 10 23:00:09.273011 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 649/1286] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 10 23:00:09 2022] DELETE /compute/v2.1/os-volumes/e184a557-eb14-441d-b0bf-7dc666231933 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:09.280834 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3dbde18d-cacf-4ba5-975b-065b5b9d86f6 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Calling method '.version_select at 0x7fa9be6c53a0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:09.313342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-3dbde18d-cacf-4ba5-975b-065b5b9d86f6 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] HTTP exception thrown: Volume c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 could not be found. Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3dbde18d-cacf-4ba5-975b-065b5b9d86f6 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Request method failure captured: Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/os-volumes/c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 HTTP/1.1 Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9Dh40IhgfHvk_SNJjMj8vxtOE-KJdO0otFdxhSTBIQAiwHHzBRGnMGHujigE9_lKw-fxHplqd8TlSxG3MZ-6vXwtZoUeAW_8HaDj4zGK1cGw277m7fBG95IDEu7szDiHVK0y_yolLLDPAM9saSsupl1g6v_940Osn7ei4UDr5GkmSig Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:00:09.315727 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8ad2ca141f324bad88198144f6273f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8ad2ca141f324bad88198144f6273f95"}]}] Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 8ad2ca141f324bad88198144f6273f95 Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-VolumesNegativeTest-1862378484 Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: f667c2b27c1f4632968c874801c01bec Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-VolumesNegativeTest-1862378484-project Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Volume c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 could not be found. Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': 'c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4'} Aug 10 23:00:09.317148 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 could not be found. (HTTP 404) (Request-ID: req-85674551-e848-46f5-8edf-5db74762f1b1) Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.322038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:00:09.323938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 could not be found. Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:00:09.325628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 could not be found. Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 could not be found. Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3dbde18d-cacf-4ba5-975b-065b5b9d86f6 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] Returning 404 to user: Volume c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3dbde18d-cacf-4ba5-975b-065b5b9d86f6 tempest-VolumesNegativeTest-1862378484 tempest-VolumesNegativeTest-1862378484-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4" status: 404 len: 109 microversion: 2.1 time: 0.042165 Aug 10 23:00:09.327208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 638/1287] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 23:00:09 2022] GET /compute/v2.1/os-volumes/c0bcf7e9-fef0-4f98-9d55-74acdaea6cb4 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:14.257715 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5c64f003-3a0f-4938-bdf1-8321c521dc49 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9c2faa8b0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:14.302494 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:14.312733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:14.320699 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5c64f003-3a0f-4938-bdf1-8321c521dc49 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/e96516b0-053d-4b8a-b430-cff8cc9aa0e2" status: 200 len: 350 microversion: 2.1 time: 0.067178 Aug 10 23:00:14.328761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 650/1288] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 23:00:14 2022] GET /compute/v2.1/os-volumes/e96516b0-053d-4b8a-b430-cff8cc9aa0e2 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:15.724717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:15.725490 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:15.731108 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7e8646f2-8277-4a45-9102-29ddfba4734b tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9be840820>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:15.792459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7e8646f2-8277-4a45-9102-29ddfba4734b tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/b7f5aca1-12fa-497e-a0d6-274741ad4752" status: 200 len: 350 microversion: 2.1 time: 0.068137 Aug 10 23:00:15.793030 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 639/1289] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 23:00:15 2022] GET /compute/v2.1/os-volumes/b7f5aca1-12fa-497e-a0d6-274741ad4752 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:17.166199 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c2ca9766-ca4f-4528-b1cd-9554ccd8dd17 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9be830790>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.217057 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c2ca9766-ca4f-4528-b1cd-9554ccd8dd17 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0946f876-bc22-4914-8890-3ba3a4ebe990" status: 200 len: 350 microversion: 2.1 time: 0.055294 Aug 10 23:00:17.217663 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 651/1290] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes/0946f876-bc22-4914-8890-3ba3a4ebe990 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:17.231253 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-31390744-0d84-4536-9a32-6b2efefd375e tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9be711820>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.313992 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-31390744-0d84-4536-9a32-6b2efefd375e tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.087229 Aug 10 23:00:17.314650 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 640/1291] 10.222.0.76 () {58 vars in 1134 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:17.329078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d5a12726-be83-4bf1-a4df-20ce5239c50c tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9c2faaaf0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.414003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d5a12726-be83-4bf1-a4df-20ce5239c50c tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088710 Aug 10 23:00:17.414716 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 652/1292] 10.222.0.76 () {58 vars in 1149 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:17.428628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-101adb08-a742-4324-9bf6-b5131ee529aa tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9be608280>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.511666 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-101adb08-a742-4324-9bf6-b5131ee529aa tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086928 Aug 10 23:00:17.512238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 641/1293] 10.222.0.76 () {58 vars in 1134 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:17.524459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6839b69e-7f2b-4e70-8a1d-400955bcaa46 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9c2f5f160>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.608095 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6839b69e-7f2b-4e70-8a1d-400955bcaa46 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087279 Aug 10 23:00:17.608662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 653/1294] 10.222.0.76 () {58 vars in 1167 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:17.621818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-104c0890-5e82-4f17-9866-b7d740a0f17d tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9be842790>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.706551 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-104c0890-5e82-4f17-9866-b7d740a0f17d tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088834 Aug 10 23:00:17.707128 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 642/1295] 10.222.0.76 () {58 vars in 1170 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:00:17.720590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4de17743-c114-499c-ac05-fb2fcad77102 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9be706ee0>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.807876 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4de17743-c114-499c-ac05-fb2fcad77102 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.090832 Aug 10 23:00:17.808445 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 654/1296] 10.222.0.76 () {58 vars in 1155 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:17.821413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9590b368-e017-4712-bfe7-d01a078d91cc tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9be7118b0>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:17.914676 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9590b368-e017-4712-bfe7-d01a078d91cc tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096939 Aug 10 23:00:17.915815 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 643/1297] 10.222.0.76 () {58 vars in 1188 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:17.928802 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-c207eb21-8541-48ac-a7f8-e9c564599197 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] Calling method '.version_select at 0x7fa9c2f0c550>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:18.012694 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-c207eb21-8541-48ac-a7f8-e9c564599197 tempest-VolumesTestJSON-1668975949 tempest-VolumesTestJSON-1668975949-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087680 Aug 10 23:00:18.013290 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 655/1298] 10.222.0.76 () {58 vars in 1155 bytes} [Wed Aug 10 23:00:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:52.871330 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-cc8d5a31-3aa0-41f6-b28e-512a1dcfd21e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Action: 'create', calling method: .version_select at 0x7fa9be7c2b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1709271121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGe01REOwli7b3f95XL4HEcAUwH/vlLbBQBSBu3m520Qa/uWiTontIqdjqXMyFj31AAPxm0V3DA1o28nQhuNNkbvXGAmAH59tdAw53TzSscdKlKm7nh5Ppnp8wardgCnEA=="}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:52.889540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-cc8d5a31-3aa0-41f6-b28e-512a1dcfd21e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:52.894652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-cc8d5a31-3aa0-41f6-b28e-512a1dcfd21e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for user bc550ece01ba4d36adc64dbb963d38d4 and project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'key_pairs'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:52.920492 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-cc8d5a31-3aa0-41f6-b28e-512a1dcfd21e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.288610 Aug 10 23:00:52.921142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 644/1299] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 10 23:00:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:01.930070 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:01:01.930680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:01:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:01:02.439421 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:01:02.439938 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:01:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:01:02.955504 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:01:02.955990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:01:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:01:20.963416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1194242557", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1709271121", "security_groups": [{"name": "tempest-secgroup-smoke-1920669246"}], "block_device_mapping_v2": [{"uuid": "98490e5a-0acc-4278-9600-c07ffe772f05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6c0f6a2-6220-499f-bfe5-9f08a5017c98"}]}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:21.076017 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] validate_networks() for [('d6c0f6a2-6220-499f-bfe5-9f08a5017c98', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:01:21.480474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:01:21.480898 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:01:21.481390 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:01:21.481796 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:01:21.482361 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:01:21.491730 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:21.492205 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:21.492639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:21.493400 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:21.493852 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:21.494368 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:21.511882 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:21.516490 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for user bc550ece01ba4d36adc64dbb963d38d4 and project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:21.575128 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:01:21.578289 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98490e5a-0acc-4278-9600-c07ffe772f05',volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:01:21.706461 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-8bf3e50b-4862-42ae-b7d5-a8e169081a41 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748418 Aug 10 23:01:21.707447 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 656/1300] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 23:01:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:01:21.716844 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=4 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:21.718297 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:21.722886 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-5f00f3ff-7c05-413f-bb28-5be86819f63d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:21.723508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-5f00f3ff-7c05-413f-bb28-5be86819f63d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:21.781603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-5f00f3ff-7c05-413f-bb28-5be86819f63d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:21.788902 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-5f00f3ff-7c05-413f-bb28-5be86819f63d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1095 microversion: 2.1 time: 0.073484 Aug 10 23:01:21.789487 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 645/1301] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:21 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:22.810624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:22.811261 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:22.818299 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:22.818786 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:22.819232 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:22.819930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:22.820389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:22.820816 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:22.881540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:22.888753 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-465213fb-6806-4afd-a702-2478a99e283f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1145 microversion: 2.1 time: 0.082617 Aug 10 23:01:22.889949 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 657/1302] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:22 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:23.911086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.911725 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:23.918129 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.918611 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.919047 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:23.919740 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.920213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.920620 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:23.980908 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:23.989159 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-496c6854-f265-464a-899a-504ca33bb4d9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1145 microversion: 2.1 time: 0.082011 Aug 10 23:01:23.989752 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 646/1303] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:23 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:25.009493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:25.010102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:25.016973 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:25.017495 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:25.017944 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:25.018639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:25.019096 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:25.019529 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:25.082090 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:25.089464 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-422d1d63-3310-481f-859c-4e1269cd8f4d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1137 microversion: 2.1 time: 0.083969 Aug 10 23:01:25.090027 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 658/1304] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:25 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:26.109673 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:26.110375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:26.117010 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:26.117545 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:26.117976 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:26.118674 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:26.119120 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:26.119539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:26.195238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:26.203032 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b8298f2e-9b5f-423c-b2c9-f67be3faa6d8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1211 microversion: 2.1 time: 0.097234 Aug 10 23:01:26.203558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 647/1305] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:26 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:27.229094 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:27.229752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:27.241294 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:27.241801 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:27.242251 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:27.242989 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:27.243458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:27.243892 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:27.531254 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:27.540077 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4cd46460-2988-4435-9a2b-3c05824f44fc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.316931 Aug 10 23:01:27.540376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 659/1306] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:27 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:27.815714 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-e64fa1d4-5710-4be9-b925-3d486edb1262 req-f8fd8ec9-0ab2-46af-bfc2-fb20bcb8e645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f83a38-e7a5-4d04-8336-6e23f442c8d2", "tag": "4a6680f0-a098-459d-b561-e045c56f6393"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:27.824895 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e64fa1d4-5710-4be9-b925-3d486edb1262 req-f8fd8ec9-0ab2-46af-bfc2-fb20bcb8e645 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:27.825400 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e64fa1d4-5710-4be9-b925-3d486edb1262 req-f8fd8ec9-0ab2-46af-bfc2-fb20bcb8e645 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:27.825838 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-e64fa1d4-5710-4be9-b925-3d486edb1262 req-f8fd8ec9-0ab2-46af-bfc2-fb20bcb8e645 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:27.837459 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-e64fa1d4-5710-4be9-b925-3d486edb1262 req-f8fd8ec9-0ab2-46af-bfc2-fb20bcb8e645 service nova] Creating event network-changed:4a6680f0-a098-459d-b561-e045c56f6393 for instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 on hv-cinder-83608 Aug 10 23:01:27.842433 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-e64fa1d4-5710-4be9-b925-3d486edb1262 req-f8fd8ec9-0ab2-46af-bfc2-fb20bcb8e645 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172736 Aug 10 23:01:27.843104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 648/1307] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:28.560585 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:28.561194 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:28.568681 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:28.569161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:28.569700 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:28.570405 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:28.570862 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:28.571292 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:28.716207 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:28.724068 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e7334099-6271-4679-9e86-17236d3f803e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.167352 Aug 10 23:01:28.724640 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 660/1308] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:28 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:29.748227 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:29.748841 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:29.755672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.756142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.756595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:29.757263 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.757736 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.758153 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:29.901955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:29.910965 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d4915939-7680-4ebc-89de-a50a5d1c5931 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.167486 Aug 10 23:01:29.911548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 649/1309] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:29 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:30.933178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:30.933917 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:30.941452 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.941947 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.942613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.943720 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.944731 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.945414 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:31.104655 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:31.114359 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e398a7aa-50a6-4a7b-9d2e-759335a8ff17 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.185462 Aug 10 23:01:31.114948 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 661/1310] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:30 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:32.136570 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:32.137344 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:32.141730 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:32.147298 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.147787 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.148221 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.149009 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.149485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.149909 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.288528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:32.298024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a157d8a0-59a2-462b-b984-fa266005482e tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.164435 Aug 10 23:01:32.298610 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 650/1311] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:32 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:33.319373 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:33.320019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:33.321915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:33.322782 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=6 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:33.330105 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:33.330594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:33.331034 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:33.331764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:33.332216 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:33.332639 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:33.467619 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:33.476345 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-23b6faac-dcfc-463c-87ba-41b74bddf5a6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.160814 Aug 10 23:01:33.476930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 662/1312] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:33 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:34.497669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:34.498238 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:34.504730 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.505219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.505687 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.506383 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.506838 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.507264 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.644371 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:34.651765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-ad169886-cdf8-4c90-9799-4b0d1fc0470f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.158072 Aug 10 23:01:34.652345 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 651/1313] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:34 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:35.673524 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:35.674119 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:35.680451 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:35.680930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:35.681387 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:35.682076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:35.682522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:35.682945 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:35.823099 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:35.831505 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-d94b7b14-4114-4854-9f6e-c6a7d9c376eb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.161920 Aug 10 23:01:35.832669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 663/1314] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:35 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:36.851922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:36.852535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:36.859714 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:36.860781 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:36.862702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:36.862702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:36.862702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:36.862993 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.001667 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:37.009181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2b5b50e7-fe84-49da-b531-78ca3e01318c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.161058 Aug 10 23:01:37.009817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 652/1315] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:36 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:38.030468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.031869 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:38.038389 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.038894 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.039329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.040019 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.040468 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.040887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.187596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:38.195565 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-66cac702-7583-4b8f-86e9-f8f09171fc0d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.169106 Aug 10 23:01:38.196134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 664/1316] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:39.176086 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-8bcdef1c-be30-4f65-8520-32d378d20ce5 req-d41e90e9-d214-4e1a-a690-2ea64f5fa4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f83a38-e7a5-4d04-8336-6e23f442c8d2", "name": "network-vif-plugged", "status": "completed", "tag": "4a6680f0-a098-459d-b561-e045c56f6393"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:39.186454 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8bcdef1c-be30-4f65-8520-32d378d20ce5 req-d41e90e9-d214-4e1a-a690-2ea64f5fa4aa service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.187144 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8bcdef1c-be30-4f65-8520-32d378d20ce5 req-d41e90e9-d214-4e1a-a690-2ea64f5fa4aa service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.188312 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-8bcdef1c-be30-4f65-8520-32d378d20ce5 req-d41e90e9-d214-4e1a-a690-2ea64f5fa4aa service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.200423 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-8bcdef1c-be30-4f65-8520-32d378d20ce5 req-d41e90e9-d214-4e1a-a690-2ea64f5fa4aa service nova] Creating event network-vif-plugged:4a6680f0-a098-459d-b561-e045c56f6393 for instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 on hv-cinder-83608 Aug 10 23:01:39.205608 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-8bcdef1c-be30-4f65-8520-32d378d20ce5 req-d41e90e9-d214-4e1a-a690-2ea64f5fa4aa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093067 Aug 10 23:01:39.206359 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 653/1317] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:39.217268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:39.217929 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:39.224544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.225034 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.225533 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.226247 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.226746 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.227168 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.367689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:39.380297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1236d8e2-9a00-4a04-b20b-3437491ecefc tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.166722 Aug 10 23:01:39.380974 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 665/1318] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:39 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:01:40.401540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:40.402223 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:40.409603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.410087 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.410522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:40.411212 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.411659 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.412079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:40.550076 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:40.557922 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-840774b7-f6e9-4f8e-96de-83fb0f941d6b tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1267 microversion: 2.1 time: 0.160646 Aug 10 23:01:40.558759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 654/1319] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:40 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:41.577817 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:41.578385 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:41.585144 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.585666 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.586104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.586803 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.587255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.587680 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.723343 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:41.731726 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-adb53498-6cf0-4d63-8666-6de35f65cbf3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1455 microversion: 2.1 time: 0.157805 Aug 10 23:01:41.732309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 666/1320] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:41 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:41.753754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:41.754375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:41.760728 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.761216 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.761695 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.762494 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.762953 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.763384 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.904242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:41.913193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-463d3838-64cb-4a37-a51d-afa4e7126581 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1455 microversion: 2.1 time: 0.163314 Aug 10 23:01:41.913809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 655/1321] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:41 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:44.071653 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-7272afad-e0c2-4778-af3a-97390a1189da req-fc8b204e-cf6d-4dbe-87c5-c4765dd3d57f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f83a38-e7a5-4d04-8336-6e23f442c8d2", "tag": "4a6680f0-a098-459d-b561-e045c56f6393"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:44.081204 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-7272afad-e0c2-4778-af3a-97390a1189da req-fc8b204e-cf6d-4dbe-87c5-c4765dd3d57f service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:44.081725 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-7272afad-e0c2-4778-af3a-97390a1189da req-fc8b204e-cf6d-4dbe-87c5-c4765dd3d57f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:44.082157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-7272afad-e0c2-4778-af3a-97390a1189da req-fc8b204e-cf6d-4dbe-87c5-c4765dd3d57f service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:44.093398 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-7272afad-e0c2-4778-af3a-97390a1189da req-fc8b204e-cf6d-4dbe-87c5-c4765dd3d57f service nova] Creating event network-changed:4a6680f0-a098-459d-b561-e045c56f6393 for instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 on hv-cinder-83608 Aug 10 23:01:44.099078 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-7272afad-e0c2-4778-af3a-97390a1189da req-fc8b204e-cf6d-4dbe-87c5-c4765dd3d57f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091852 Aug 10 23:01:44.099676 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 667/1322] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:10.822867 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9be6122e-688d-4d16-b863-3be74ea03f5c] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 23:04:10.823623 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=24 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:10.824354 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=52 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:10.828103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:10.828592 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:10.835651 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:10.836127 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:10.836558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:10.837243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:10.837717 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:10.838137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:10.863177 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:10.920607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [0ed49a78-39aa-401e-bec0-016bdb9a93ab] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:04:11.830859 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] [9be6122e-688d-4d16-b863-3be74ea03f5c] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33846. Aug 10 23:04:11.928247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [0ed49a78-39aa-401e-bec0-016bdb9a93ab] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33848. Aug 10 23:04:11.948370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-50ec3377-8b91-47de-9772-2d9b53992e7f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 204 len: 0 microversion: 2.1 time: 1.127489 Aug 10 23:04:11.948944 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 656/1323] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:10 2022] DELETE /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 0 bytes in 1129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:04:11.956279 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38ddad75-67d8-4e5d-9ab8-27045c974303] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:04:11.957155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:11.958640 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=64 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:11.963739 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:11.964435 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:11.971884 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:11.972629 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:11.973070 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:11.973821 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:11.974376 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:11.974802 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:12.220337 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:12.228650 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-4e009098-5a8b-4e14-b6b5-7fb36cb11a01 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1579 microversion: 2.1 time: 0.275010 Aug 10 23:04:12.229211 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 668/1324] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:11 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1579 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:13.250706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:13.251398 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:13.259103 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:13.259581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:13.260021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:13.260706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:13.261156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:13.261602 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:13.468734 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:13.477474 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e71af150-4f05-42a4-81ae-558809590da2 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1579 microversion: 2.1 time: 0.230888 Aug 10 23:04:13.478055 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 657/1325] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:13 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1579 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:14.500215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:14.500931 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:14.510161 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:14.510751 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:14.511276 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:14.512003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:14.512459 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:14.512924 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:14.518838 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] [38ddad75-67d8-4e5d-9ab8-27045c974303] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33862. Aug 10 23:04:14.629496 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:14.638100 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-03b7ee26-ec2f-48c9-a3b6-f7398db41ad8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 200 len: 1511 microversion: 2.1 time: 0.141722 Aug 10 23:04:14.638878 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 669/1326] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:14 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 1511 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:14.740194 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-ad646283-e55c-48d9-af92-4f21175d724a req-9e9ca411-7194-42b1-8a9d-605fa381e779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f83a38-e7a5-4d04-8336-6e23f442c8d2", "name": "network-vif-deleted", "tag": "4a6680f0-a098-459d-b561-e045c56f6393"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:14.757607 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ad646283-e55c-48d9-af92-4f21175d724a req-9e9ca411-7194-42b1-8a9d-605fa381e779 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:14.758430 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ad646283-e55c-48d9-af92-4f21175d724a req-9e9ca411-7194-42b1-8a9d-605fa381e779 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:14.759308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-ad646283-e55c-48d9-af92-4f21175d724a req-9e9ca411-7194-42b1-8a9d-605fa381e779 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:14.771887 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-ad646283-e55c-48d9-af92-4f21175d724a req-9e9ca411-7194-42b1-8a9d-605fa381e779 service nova] Creating event network-vif-deleted:4a6680f0-a098-459d-b561-e045c56f6393 for instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 on hv-cinder-83608 Aug 10 23:04:14.778540 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-ad646283-e55c-48d9-af92-4f21175d724a req-9e9ca411-7194-42b1-8a9d-605fa381e779 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043078 Aug 10 23:04:14.779232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 658/1327] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:15.658834 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:15.659540 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:15.667866 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:15.668285 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:15.668717 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:15.669437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:15.669886 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:15.670302 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:15.683675 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] HTTP exception thrown: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Request method failure captured: Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 HTTP/1.1 Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9Dif4-h3Vp-bA0jwM2QN4czZqwAYSUTByS0WtK4lQu0pDhIiPOkAuSUxmQMM6DibalLQz_97OrWWP5mQc5IMJaLbrutpbKMCEPD9hGNtQpUwRIJymSxObAjowvZAxEug_HBbAnqXJ5_FyoSzd7uh45ssTtzZ2waCHYBTWKWU7r0wfuY Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:04:15.685319 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}] Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-TestVolumeBootPattern-755905585 Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: bc550ece01ba4d36adc64dbb963d38d4 Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:04:15.687146 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'd1f83a38-e7a5-4d04-8336-6e23f442c8d2'} Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:15.688197 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:04:15.689711 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:04:15.691001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Returning 404 to user: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:15.691001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-21261f69-854b-4a33-9735-f26f8181665a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 404 len: 111 microversion: 2.1 time: 0.031968 Aug 10 23:04:15.691001 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 670/1328] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:15 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:15.791774 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-265547538", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1709271121", "security_groups": [{"name": "tempest-secgroup-smoke-1920669246"}], "block_device_mapping_v2": [{"uuid": "98490e5a-0acc-4278-9600-c07ffe772f05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6c0f6a2-6220-499f-bfe5-9f08a5017c98"}]}} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:15.912989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.network.neutron [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] validate_networks() for [('d6c0f6a2-6220-499f-bfe5-9f08a5017c98', None, None, None, None, None)] {{(pid=132541) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:04:16.586413 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Flavor limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:04:16.586870 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Image limits 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:04:16.587349 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Flavor pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:04:16.587765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Image pref 0:0:0 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:04:16.588200 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.virt.hardware [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:04:16.597600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:16.598082 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:16.599170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:16.600119 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:16.600576 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:16.601012 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:16.618669 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:16.622617 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.quota [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for user bc550ece01ba4d36adc64dbb963d38d4 and project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:16.680011 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Going to run 1 instances... {{(pid=132541) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:04:16.682353 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98490e5a-0acc-4278-9600-c07ffe772f05',volume_size=None,volume_type=None)] {{(pid=132541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:04:16.810139 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [4b3377a2-f534-4b9a-8d39-a1e844646742] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:04:17.817426 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [4b3377a2-f534-4b9a-8d39-a1e844646742] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33888. Aug 10 23:04:17.822170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-c12efb6f-6943-49ed-bcbc-1c59dd9ea4a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.034764 Aug 10 23:04:17.822817 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 659/1329] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 23:04:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:04:17.833522 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-767ebedc-74c3-41e1-9aa2-2741e8128451 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:17.834427 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-767ebedc-74c3-41e1-9aa2-2741e8128451 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:17.887660 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-767ebedc-74c3-41e1-9aa2-2741e8128451 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:17.894988 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-767ebedc-74c3-41e1-9aa2-2741e8128451 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1094 microversion: 2.1 time: 0.065367 Aug 10 23:04:17.895538 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 671/1330] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:17 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:18.915668 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-72085b86-b3a7-4d75-a2e9-fcd4b31bc36a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:18.916275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-72085b86-b3a7-4d75-a2e9-fcd4b31bc36a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:18.971818 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-72085b86-b3a7-4d75-a2e9-fcd4b31bc36a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:18.979242 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-72085b86-b3a7-4d75-a2e9-fcd4b31bc36a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1094 microversion: 2.1 time: 0.067939 Aug 10 23:04:18.979809 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 660/1331] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:18 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:20.000165 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6a02d8da-e582-403f-a4ea-4b7634d733b6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:20.000839 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6a02d8da-e582-403f-a4ea-4b7634d733b6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:20.055828 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6a02d8da-e582-403f-a4ea-4b7634d733b6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:20.062596 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6a02d8da-e582-403f-a4ea-4b7634d733b6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1094 microversion: 2.1 time: 0.066397 Aug 10 23:04:20.063164 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 672/1332] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:19 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:21.082883 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-812b7eb7-ef3e-4588-b052-420d0b281272 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:21.084342 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-812b7eb7-ef3e-4588-b052-420d0b281272 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:21.136438 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-812b7eb7-ef3e-4588-b052-420d0b281272 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:21.143123 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-812b7eb7-ef3e-4588-b052-420d0b281272 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1094 microversion: 2.1 time: 0.064100 Aug 10 23:04:21.143685 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 661/1333] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:21 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:21.938698 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:04:21.939315 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:04:22.164764 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:22.165403 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:22.172347 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:22.172835 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:22.173273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:22.173994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:22.174448 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:22.174877 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:22.238741 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:22.246662 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-5e53ea51-6bb2-4b38-bb90-78a0347e72ac tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1144 microversion: 2.1 time: 0.086417 Aug 10 23:04:22.247226 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 673/1334] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:22 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:22.963870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:04:22.964689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:04:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:04:23.267173 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:23.267942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:23.275719 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:23.276319 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:23.276769 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:23.277517 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:23.277979 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:23.278409 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:23.357790 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:23.366344 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-6ff57233-91ba-436d-8eb4-2cffcd56f694 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1210 microversion: 2.1 time: 0.102973 Aug 10 23:04:23.367038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 662/1335] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:23 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:24.339171 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6abbc929-0be3-4234-926d-4544e48edcac", "tag": "3e9abda7-4473-4e3e-90a7-250c48b9e389"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:24.350266 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:24.359854 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:24.360358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.371979 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] Creating event network-changed:3e9abda7-4473-4e3e-90a7-250c48b9e389 for instance 6abbc929-0be3-4234-926d-4544e48edcac on hv-cinder-83608 Aug 10 23:04:24.375358 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR oslo.messaging._drivers.impl_rabbit [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] [5a6fbb6c-e8d2-4ebb-b27b-478e0bdd2148] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:04:24.387960 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:24.388592 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:24.394955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:24.396275 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:24.396515 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.397485 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:24.397881 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:24.398326 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.637193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:24.644709 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-da1c7941-cdbc-43b1-b0e7-d36795ea6aae tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.260648 Aug 10 23:04:24.645287 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 663/1336] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:24 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:25.382930 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] [5a6fbb6c-e8d2-4ebb-b27b-478e0bdd2148] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33934. Aug 10 23:04:25.386156 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-aa6c4f0f-4917-4e48-ac67-33ca6aa455ba req-f7ce4d12-8de3-4e73-aa61-0d5a58552c09 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.051051 Aug 10 23:04:25.387082 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 674/1337] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:25.668038 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:25.668637 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:25.675380 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:25.675929 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:25.676375 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:25.677940 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:25.678467 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:25.678897 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:25.891248 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:25.899647 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-056869eb-caa4-47c9-a419-ed99aaf0de94 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.236096 Aug 10 23:04:25.900219 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 664/1338] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:25 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:26.921064 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:26.921703 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:26.928104 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:26.928588 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:26.929059 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:26.929791 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:26.930244 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:26.930669 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:27.062329 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:27.070370 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-6d5936ab-add5-4c34-a49f-f3dae26d8828 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.154085 Aug 10 23:04:27.070942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 675/1339] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:26 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:28.091644 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:28.092280 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:28.094231 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:28.100630 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:28.101122 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:28.101593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:28.102294 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:28.102755 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:28.103185 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:28.238307 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:28.246304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-e80d9ac6-c738-4220-8aa0-83fa290d1dc0 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.158512 Aug 10 23:04:28.246873 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 665/1340] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:28 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:29.267847 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:29.268613 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:29.276030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:29.276509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:29.276942 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:29.277667 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:29.278115 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:29.278534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:29.413629 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:29.421493 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-35037f5f-10a7-4da2-965e-abaf20cc1557 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.157538 Aug 10 23:04:29.422070 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 676/1341] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:29 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:30.442532 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:30.443141 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:30.449537 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:30.450021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:30.450457 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:30.451175 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:30.451624 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:30.452043 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:30.586896 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:30.594385 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4f19d610-c548-415b-ba28-ccdbd71cd57f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.155696 Aug 10 23:04:30.594958 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 666/1342] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:30 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:31.616344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:31.616980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:31.618919 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=4 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:31.624761 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.625250 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.625722 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.626418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.626870 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.627296 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.759696 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:31.767074 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-97d30231-317c-4d07-98a0-223ad5167076 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.154892 Aug 10 23:04:31.767648 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 677/1343] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:31 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:32.788704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:32.789304 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:32.791136 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=10 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:32.796760 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:32.797243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:32.797702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:32.798396 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:32.798850 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:32.799279 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:32.939628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:32.947603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4810c86e-b975-4dce-80a1-f47664a40811 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.163460 Aug 10 23:04:32.948155 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 667/1344] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:32 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:33.968004 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:33.968625 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:33.976536 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.977030 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.977509 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.978224 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.978682 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.979111 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:34.116958 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:34.124387 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-1cc03030-92a3-4c35-b9ca-9dc3c1366372 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.160263 Aug 10 23:04:34.124964 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 678/1345] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:33 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:35.144557 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:35.145232 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:35.151757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:35.152243 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:35.152681 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:35.153405 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:35.153859 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:35.154284 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:35.289855 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:35.297269 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-7ee1929f-ddec-4b2d-8871-59b83c1fe666 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.156637 Aug 10 23:04:35.297845 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 668/1346] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:35 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:36.141599 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-27760445-2773-499b-bf29-7d908d2388fd req-dcf2e35b-5ee7-465c-b12b-282c3347ebf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6abbc929-0be3-4234-926d-4544e48edcac", "name": "network-vif-plugged", "status": "completed", "tag": "3e9abda7-4473-4e3e-90a7-250c48b9e389"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:36.151283 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-27760445-2773-499b-bf29-7d908d2388fd req-dcf2e35b-5ee7-465c-b12b-282c3347ebf2 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:36.151851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-27760445-2773-499b-bf29-7d908d2388fd req-dcf2e35b-5ee7-465c-b12b-282c3347ebf2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:36.152312 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-27760445-2773-499b-bf29-7d908d2388fd req-dcf2e35b-5ee7-465c-b12b-282c3347ebf2 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.164339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-27760445-2773-499b-bf29-7d908d2388fd req-dcf2e35b-5ee7-465c-b12b-282c3347ebf2 service nova] Creating event network-vif-plugged:3e9abda7-4473-4e3e-90a7-250c48b9e389 for instance 6abbc929-0be3-4234-926d-4544e48edcac on hv-cinder-83608 Aug 10 23:04:36.169239 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-27760445-2773-499b-bf29-7d908d2388fd req-dcf2e35b-5ee7-465c-b12b-282c3347ebf2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Aug 10 23:04:36.169977 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 679/1347] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:36.318836 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:36.320059 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:36.326665 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:36.327156 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:36.327597 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.328300 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:36.328756 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:36.329181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.523110 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:36.530595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3b210bbd-59de-4d06-88fc-b1ede3df01fb tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.215874 Aug 10 23:04:36.531163 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 669/1348] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:36 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:37.553367 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:37.554076 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:37.560378 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.560868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.561333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:37.562033 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.562492 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.562927 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:37.699767 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:37.707598 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-e22c4e41-4feb-4d66-94f2-67563e981326 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1266 microversion: 2.1 time: 0.158949 Aug 10 23:04:37.708178 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 680/1349] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:37 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:38.728142 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:38.728737 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:38.735265 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:38.735754 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:38.736197 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:38.736899 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:38.737406 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:38.738395 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:38.871477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:38.879765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-752ecabb-03a6-4d3d-b5a6-f196d8dec683 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1453 microversion: 2.1 time: 0.155560 Aug 10 23:04:38.880337 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 670/1350] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:38 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:38.899805 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:38.900416 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:38.906766 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:38.907249 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:38.907684 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:38.908380 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:38.908831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:38.909253 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:39.038017 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:39.045467 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-a2996fec-fd0a-4247-b019-18ff30ffeb75 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1453 microversion: 2.1 time: 0.149455 Aug 10 23:04:39.046041 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 681/1351] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:38 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:40.650889 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [req-2c34ca2b-c15e-4fda-9b46-cb502bc50f19 req-6ef9dc7d-9265-4980-aaf5-e8177c65a54d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6abbc929-0be3-4234-926d-4544e48edcac", "tag": "3e9abda7-4473-4e3e-90a7-250c48b9e389"}]} {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:40.661539 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-2c34ca2b-c15e-4fda-9b46-cb502bc50f19 req-6ef9dc7d-9265-4980-aaf5-e8177c65a54d service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.662024 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-2c34ca2b-c15e-4fda-9b46-cb502bc50f19 req-6ef9dc7d-9265-4980-aaf5-e8177c65a54d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.662461 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [req-2c34ca2b-c15e-4fda-9b46-cb502bc50f19 req-6ef9dc7d-9265-4980-aaf5-e8177c65a54d service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.673766 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.compute.server_external_events [req-2c34ca2b-c15e-4fda-9b46-cb502bc50f19 req-6ef9dc7d-9265-4980-aaf5-e8177c65a54d service nova] Creating event network-changed:3e9abda7-4473-4e3e-90a7-250c48b9e389 for instance 6abbc929-0be3-4234-926d-4544e48edcac on hv-cinder-83608 Aug 10 23:04:40.680023 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [req-2c34ca2b-c15e-4fda-9b46-cb502bc50f19 req-6ef9dc7d-9265-4980-aaf5-e8177c65a54d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032880 Aug 10 23:04:40.680621 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 671/1352] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:53.465045 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:05:53.465672 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:05:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:07:07.217189 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=32 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:07.217984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=60 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:07.222241 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1815764086", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1709271121", "security_groups": [{"name": "tempest-secgroup-smoke-1920669246"}], "block_device_mapping_v2": [{"uuid": "4892e757-ee59-4f07-a29c-bcb85db0e848", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6c0f6a2-6220-499f-bfe5-9f08a5017c98"}]}} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:07.336874 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.network.neutron [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] validate_networks() for [('d6c0f6a2-6220-499f-bfe5-9f08a5017c98', None, None, None, None, None)] {{(pid=132540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:07:07.777085 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Flavor limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:07.777544 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Image limits 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:07.778010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Flavor pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:07.778412 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Image pref 0:0:0 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:07.779441 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.virt.hardware [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:07.788793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:07.788793 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:07.789081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.789621 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:07.790069 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:07.790486 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.807406 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:07:07.811284 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.quota [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Getting quotas for user bc550ece01ba4d36adc64dbb963d38d4 and project 19b7bdf29e5d4fad87f8991179fc46ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:07:07.868190 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Going to run 1 instances... {{(pid=132540) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:07:07.870332 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4892e757-ee59-4f07-a29c-bcb85db0e848',volume_size=None,volume_type=None)] {{(pid=132540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:07:08.002081 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-f64a4396-d200-4bf8-865f-0b5b4724ed0f tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786777 Aug 10 23:07:08.002732 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 682/1353] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:07:08.012292 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9be6122e-688d-4d16-b863-3be74ea03f5c] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 23:07:08.012981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:08.013925 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:08.018585 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4be8b588-d7c3-4c13-9b44-26d24e9b5eef tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:08.019296 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4be8b588-d7c3-4c13-9b44-26d24e9b5eef tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:08.077949 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-4be8b588-d7c3-4c13-9b44-26d24e9b5eef tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:08.084860 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4be8b588-d7c3-4c13-9b44-26d24e9b5eef tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1095 microversion: 2.1 time: 0.074972 Aug 10 23:07:08.085482 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 672/1354] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:08 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:09.105155 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:09.105808 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:09.114255 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:09.114749 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:09.115394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:09.116212 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:09.116660 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:09.117268 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:09.223508 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:09.230859 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2777caf0-4904-4f93-b72d-87737521eba5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1211 microversion: 2.1 time: 0.129510 Aug 10 23:07:09.231460 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 683/1355] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:09 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1211 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:10.253293 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:10.253989 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:10.262678 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.263246 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.263688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.264398 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.264852 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.265305 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.281460 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] [9be6122e-688d-4d16-b863-3be74ea03f5c] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 34082. Aug 10 23:07:10.509504 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-d714862d-08b4-4290-8830-8b4f595969d7 req-dafd6066-66cb-440d-8a8a-8ab673f60d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b6216d-bd8c-4818-b5a5-0d9aca23ee62", "tag": "bda015ea-d70c-4218-8885-52cd18fd9f6f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:10.519043 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d714862d-08b4-4290-8830-8b4f595969d7 req-dafd6066-66cb-440d-8a8a-8ab673f60d60 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.519517 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d714862d-08b4-4290-8830-8b4f595969d7 req-dafd6066-66cb-440d-8a8a-8ab673f60d60 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.519945 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-d714862d-08b4-4290-8830-8b4f595969d7 req-dafd6066-66cb-440d-8a8a-8ab673f60d60 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.531665 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-d714862d-08b4-4290-8830-8b4f595969d7 req-dafd6066-66cb-440d-8a8a-8ab673f60d60 service nova] Creating event network-changed:bda015ea-d70c-4218-8885-52cd18fd9f6f for instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 on hv-cinder-83608 Aug 10 23:07:10.536568 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-d714862d-08b4-4290-8830-8b4f595969d7 req-dafd6066-66cb-440d-8a8a-8ab673f60d60 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139202 Aug 10 23:07:10.537372 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 684/1356] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:10.543602 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:10.551682 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-b187841e-0567-443f-b267-21967105c2bd tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.302280 Aug 10 23:07:10.552244 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 673/1357] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:10 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:11.575134 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:11.575847 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:11.582385 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:11.582872 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:11.583309 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:11.584004 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:11.584456 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:11.584887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:11.716934 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:11.724388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ac40953a-f222-4304-af05-4cc181d99614 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.154585 Aug 10 23:07:11.724960 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 685/1358] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:11 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:12.745377 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:12.745998 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:12.752415 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.752901 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.753381 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.754101 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.754543 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.754983 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.890572 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:12.897960 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-daa97a56-d1e0-4523-8797-55bdf5557c36 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.156514 Aug 10 23:07:12.898528 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 674/1359] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:12 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:13.918962 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:13.919674 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:13.926215 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.926736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.927180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.927887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.928344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.928778 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:14.064915 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:14.072330 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-351c0c32-c653-4ea9-941d-080bba35f0f1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.157292 Aug 10 23:07:14.072906 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 686/1360] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:13 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:15.093595 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:15.094241 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:15.100581 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.101071 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.101547 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.102247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.102706 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.103137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.255593 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:15.267245 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-95c96d96-27e8-4d52-8c58-47ce8d8d43a1 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.177689 Aug 10 23:07:15.267828 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 675/1361] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:15 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:16.291392 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:16.292015 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:16.298238 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.298733 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.299174 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.299873 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.300333 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.300763 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.435849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:16.443236 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ffa6bb1c-4449-4399-892f-2979e3a9ce1c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.155719 Aug 10 23:07:16.443810 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 687/1362] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:16 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:17.465960 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:17.466592 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:17.473942 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.474333 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.474776 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:17.475477 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.475932 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.476358 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:17.609749 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:17.617181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-2a14d08d-ad62-4385-960f-bee27a594d6c tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.155760 Aug 10 23:07:17.617776 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 676/1363] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:17 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:18.638944 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:18.639560 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:18.641980 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=2 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:18.642667 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell0:SELECT=6 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:18.648943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.649455 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.649896 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.650586 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.651036 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.651458 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.784846 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:18.792321 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ad836c0c-d3d6-470d-a5d2-4944d4d72d83 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.157936 Aug 10 23:07:18.792900 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 688/1364] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:18 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:19.812112 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.812759 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.814578 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell0:SELECT=2 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:19.820170 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.820652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.821084 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.821804 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.822249 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.822670 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.960733 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:19.968864 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-99be5a39-06d1-4fd0-a739-8cc86b6096b5 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.160665 Aug 10 23:07:19.969449 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 677/1365] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:19 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:20.896724 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-c6e77e8a-f735-4ee4-a68d-3352bd70c82e req-9094ff4d-559d-44fe-aa84-87f642a3f853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b6216d-bd8c-4818-b5a5-0d9aca23ee62", "name": "network-vif-plugged", "status": "completed", "tag": "bda015ea-d70c-4218-8885-52cd18fd9f6f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:20.907139 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-c6e77e8a-f735-4ee4-a68d-3352bd70c82e req-9094ff4d-559d-44fe-aa84-87f642a3f853 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.907624 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-c6e77e8a-f735-4ee4-a68d-3352bd70c82e req-9094ff4d-559d-44fe-aa84-87f642a3f853 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.908056 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-c6e77e8a-f735-4ee4-a68d-3352bd70c82e req-9094ff4d-559d-44fe-aa84-87f642a3f853 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.919990 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-c6e77e8a-f735-4ee4-a68d-3352bd70c82e req-9094ff4d-559d-44fe-aa84-87f642a3f853 service nova] Creating event network-vif-plugged:bda015ea-d70c-4218-8885-52cd18fd9f6f for instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 on hv-cinder-83608 Aug 10 23:07:20.924887 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-c6e77e8a-f735-4ee4-a68d-3352bd70c82e req-9094ff4d-559d-44fe-aa84-87f642a3f853 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089117 Aug 10 23:07:20.925578 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 689/1366] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:20.989987 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:20.990548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:20.996964 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.997483 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.997929 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.998628 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.999077 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.999505 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:21.147757 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:21.156081 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-a5d3f2dd-02ef-4726-aa9d-0c2f8770a475 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.170280 Aug 10 23:07:21.156652 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 678/1367] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:20 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:22.178607 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:22.179297 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:22.186437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.186914 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.187346 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.188036 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.188487 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.188904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.335150 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:22.343180 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-550337e6-b265-4089-aebc-1205e76cd9b8 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.169311 Aug 10 23:07:22.343748 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 690/1368] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:22 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:23.366506 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:23.367131 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:23.374702 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.375523 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.375683 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.377247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.377247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.377247 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.518178 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:23.525688 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-3b3fdda8-429d-4683-8d4b-60d7961a0680 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1267 microversion: 2.1 time: 0.164202 Aug 10 23:07:23.526259 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 679/1369] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:23 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:24.546012 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:24.546690 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:24.553089 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.553621 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.554062 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.554755 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.555209 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.555631 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.685957 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.693418 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-2d3478ed-c417-484b-9cc2-2c6b69e706c4 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1454 microversion: 2.1 time: 0.151411 Aug 10 23:07:24.693991 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 691/1370] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:24 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:24.714079 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:24.714684 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:24.721005 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.721520 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.721955 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.722641 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.723088 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.723512 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.857054 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.864664 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-43da2bc2-09f5-4b95-9224-2c11d62493c6 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1454 microversion: 2.1 time: 0.154333 Aug 10 23:07:24.865234 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 680/1371] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:24 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:26.825904 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-956924a3-3eed-4be8-a4d5-6092b11d5b5f req-51a38be0-df5b-42a6-ad1d-abda0cbe611e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b6216d-bd8c-4818-b5a5-0d9aca23ee62", "tag": "bda015ea-d70c-4218-8885-52cd18fd9f6f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:26.836010 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-956924a3-3eed-4be8-a4d5-6092b11d5b5f req-51a38be0-df5b-42a6-ad1d-abda0cbe611e service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.836582 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-956924a3-3eed-4be8-a4d5-6092b11d5b5f req-51a38be0-df5b-42a6-ad1d-abda0cbe611e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.837016 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-956924a3-3eed-4be8-a4d5-6092b11d5b5f req-51a38be0-df5b-42a6-ad1d-abda0cbe611e service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.853437 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-956924a3-3eed-4be8-a4d5-6092b11d5b5f req-51a38be0-df5b-42a6-ad1d-abda0cbe611e service nova] Creating event network-changed:bda015ea-d70c-4218-8885-52cd18fd9f6f for instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 on hv-cinder-83608 Aug 10 23:07:26.859253 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-956924a3-3eed-4be8-a4d5-6092b11d5b5f req-51a38be0-df5b-42a6-ad1d-abda0cbe611e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Aug 10 23:07:26.860037 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 692/1372] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:42.973128 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:07:42.973902 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:07:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:07:57.408299 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:07:57.408811 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:09:13.473856 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:09:13.474475 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:09:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:09:21.948704 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:09:21.949353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:09:22.453091 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:09:22.453638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:09:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:09:45.129808 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38ddad75-67d8-4e5d-9ab8-27045c974303] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:09:45.130360 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:45.130752 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.130854 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:45.131959 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG dbcounter [-] [132540] Writing DB stats nova_cell1:SELECT=50 {{(pid=132540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.133308 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_api:SELECT=20 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.134853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG dbcounter [-] [132541] Writing DB stats nova_cell1:SELECT=48 {{(pid=132541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.137849 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-45ef1fd6-d657-4d35-aaa4-fbc3c3591f4f req-42dc08d3-8c79-43e8-bb02-762e6e4c341c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b6216d-bd8c-4818-b5a5-0d9aca23ee62", "tag": "bda015ea-d70c-4218-8885-52cd18fd9f6f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:45.141840 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.142601 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.143295 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.144117 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.144682 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.145213 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.149597 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-45ef1fd6-d657-4d35-aaa4-fbc3c3591f4f req-42dc08d3-8c79-43e8-bb02-762e6e4c341c service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.150217 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-45ef1fd6-d657-4d35-aaa4-fbc3c3591f4f req-42dc08d3-8c79-43e8-bb02-762e6e4c341c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.150854 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-45ef1fd6-d657-4d35-aaa4-fbc3c3591f4f req-42dc08d3-8c79-43e8-bb02-762e6e4c341c service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.162017 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-45ef1fd6-d657-4d35-aaa4-fbc3c3591f4f req-42dc08d3-8c79-43e8-bb02-762e6e4c341c service nova] Creating event network-changed:bda015ea-d70c-4218-8885-52cd18fd9f6f for instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 on hv-cinder-83608 Aug 10 23:09:45.167315 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-45ef1fd6-d657-4d35-aaa4-fbc3c3591f4f req-42dc08d3-8c79-43e8-bb02-762e6e4c341c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039161 Aug 10 23:09:45.168157 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 693/1373] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:09:45.173104 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:45.278548 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-47a5d941-0c05-42b6-95a7-c175cfd79d90 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "DELETE /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 204 len: 0 microversion: 2.1 time: 0.152898 Aug 10 23:09:45.279336 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 681/1374] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:45 2022] DELETE /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:45.287868 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:45.288558 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:45.294984 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.295474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.295910 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.296610 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.297055 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.297879 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.485672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:45.493323 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-0b1c4eb5-352d-4d4f-a476-37c5bcf8c33d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1578 microversion: 2.1 time: 0.209507 Aug 10 23:09:45.493968 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 694/1375] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:45 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:46.515021 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:46.515853 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:46.522615 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:46.522961 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:46.523401 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:46.524627 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:46.525081 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:46.525541 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:46.783981 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:46.792621 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-dbc73ef9-7e6f-4d12-bbe3-1a7b065d772d tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1578 microversion: 2.1 time: 0.281760 Aug 10 23:09:46.793199 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 682/1376] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:46 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1578 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:47.671252 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] [38ddad75-67d8-4e5d-9ab8-27045c974303] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 34206. Aug 10 23:09:47.723851 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-82d867bd-1c99-42d4-bc41-690fa40511c0 req-3c0ae0fb-d0a1-4938-a35b-3f1a3e61df35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b6216d-bd8c-4818-b5a5-0d9aca23ee62", "name": "network-vif-deleted", "tag": "bda015ea-d70c-4218-8885-52cd18fd9f6f"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:47.735125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-82d867bd-1c99-42d4-bc41-690fa40511c0 req-3c0ae0fb-d0a1-4938-a35b-3f1a3e61df35 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:47.735622 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-82d867bd-1c99-42d4-bc41-690fa40511c0 req-3c0ae0fb-d0a1-4938-a35b-3f1a3e61df35 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:47.736298 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-82d867bd-1c99-42d4-bc41-690fa40511c0 req-3c0ae0fb-d0a1-4938-a35b-3f1a3e61df35 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:47.747668 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-82d867bd-1c99-42d4-bc41-690fa40511c0 req-3c0ae0fb-d0a1-4938-a35b-3f1a3e61df35 service nova] Creating event network-vif-deleted:bda015ea-d70c-4218-8885-52cd18fd9f6f for instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 on hv-cinder-83608 Aug 10 23:09:47.752293 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-82d867bd-1c99-42d4-bc41-690fa40511c0 req-3c0ae0fb-d0a1-4938-a35b-3f1a3e61df35 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093571 Aug 10 23:09:47.753052 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 695/1377] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:09:47.813412 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:47.813936 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:47.820704 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:47.821705 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:47.822179 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:47.822868 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:47.823325 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:47.823742 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:47.890442 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:47.898067 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-05005d98-b7b0-42ee-bfc5-be0bf2f4e9a9 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 200 len: 1226 microversion: 2.1 time: 0.088599 Aug 10 23:09:47.898638 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 683/1378] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:47 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:48.920328 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:48.921065 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 12b6216d-bd8c-4818-b5a5-0d9aca23ee62] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:48.927231 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.927718 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.928160 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.928856 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.929339 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.929769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.945003 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] HTTP exception thrown: Instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 could not be found. Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Request method failure captured: Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 HTTP/1.1 Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9Dif4-h3Vp-bA0jwM2QN4czZqwAYSUTByS0WtK4lQu0pDhIiPOkAuSUxmQMM6DibalLQz_97OrWWP5mQc5IMJaLbrutpbKMCEPD9hGNtQpUwRIJymSxObAjowvZAxEug_HBbAnqXJ5_FyoSzd7uh45ssTtzZ2waCHYBTWKWU7r0wfuY Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:09:48.946672 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}] Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: bc550ece01ba4d36adc64dbb963d38d4 Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 could not be found. Aug 10 23:09:48.948507 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': '12b6216d-bd8c-4818-b5a5-0d9aca23ee62'} Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 could not be found. Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:48.949594 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 could not be found. Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 could not be found. Aug 10 23:09:48.951344 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.952952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Returning 404 to user: Instance 12b6216d-bd8c-4818-b5a5-0d9aca23ee62 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:48.952952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ff9bf92c-2f98-4194-a55a-7b87a85fc494 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62" status: 404 len: 111 microversion: 2.1 time: 0.033417 Aug 10 23:09:48.952952 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 696/1379] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:48 2022] GET /compute/v2.1/servers/12b6216d-bd8c-4818-b5a5-0d9aca23ee62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:52.054574 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:52.055422 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:52.056588 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-5135a577-b795-4d3d-9ffa-db1188892384 req-61a397a3-2118-4833-95af-9a78525c86d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6abbc929-0be3-4234-926d-4544e48edcac", "tag": "3e9abda7-4473-4e3e-90a7-250c48b9e389"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:52.062222 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:52.062848 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:52.063675 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:52.064508 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:52.065072 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:52.065900 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:52.067958 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5135a577-b795-4d3d-9ffa-db1188892384 req-61a397a3-2118-4833-95af-9a78525c86d7 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:52.068474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5135a577-b795-4d3d-9ffa-db1188892384 req-61a397a3-2118-4833-95af-9a78525c86d7 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:52.068916 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-5135a577-b795-4d3d-9ffa-db1188892384 req-61a397a3-2118-4833-95af-9a78525c86d7 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:52.082125 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-5135a577-b795-4d3d-9ffa-db1188892384 req-61a397a3-2118-4833-95af-9a78525c86d7 service nova] Creating event network-changed:3e9abda7-4473-4e3e-90a7-250c48b9e389 for instance 6abbc929-0be3-4234-926d-4544e48edcac on hv-cinder-83608 Aug 10 23:09:52.088394 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-5135a577-b795-4d3d-9ffa-db1188892384 req-61a397a3-2118-4833-95af-9a78525c86d7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035385 Aug 10 23:09:52.089425 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 697/1380] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:52.096532 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Going to try to terminate instance {{(pid=132541) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:52.184081 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-9c54b8bb-436a-4d9d-8c26-b9c111cc7fb3 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 204 len: 0 microversion: 2.1 time: 0.133191 Aug 10 23:09:52.185228 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 684/1381] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:52 2022] DELETE /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:52.194534 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:52.195235 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:52.202353 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:52.203136 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:52.203579 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:52.204280 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:52.204943 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:52.205689 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:52.344273 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.policy [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:52.353513 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-ed000e5e-c5fe-416b-8972-252f38d11806 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1578 microversion: 2.1 time: 0.163343 Aug 10 23:09:52.354102 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 698/1382] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:52 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:53.375864 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:53.376715 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:53.384600 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:53.385111 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:53.385573 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:53.386283 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:53.386730 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:53.387181 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:53.530240 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.policy [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc550ece01ba4d36adc64dbb963d38d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b7bdf29e5d4fad87f8991179fc46ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132541) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:53.537793 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-d9c04d1e-8019-48a4-83a4-999c35fdba39 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 200 len: 1459 microversion: 2.1 time: 0.166129 Aug 10 23:09:53.538369 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 685/1383] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:53 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 1459 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:54.104467 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [req-890291e7-79a4-4397-ba19-1ea1198dd6e8 req-ade141cf-7fc8-4b7f-95f1-13c3bec19916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6abbc929-0be3-4234-926d-4544e48edcac", "name": "network-vif-deleted", "tag": "3e9abda7-4473-4e3e-90a7-250c48b9e389"}]} {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:54.113922 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-890291e7-79a4-4397-ba19-1ea1198dd6e8 req-ade141cf-7fc8-4b7f-95f1-13c3bec19916 service nova] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:54.114402 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-890291e7-79a4-4397-ba19-1ea1198dd6e8 req-ade141cf-7fc8-4b7f-95f1-13c3bec19916 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:54.114834 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [req-890291e7-79a4-4397-ba19-1ea1198dd6e8 req-ade141cf-7fc8-4b7f-95f1-13c3bec19916 service nova] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:54.125891 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.compute.server_external_events [req-890291e7-79a4-4397-ba19-1ea1198dd6e8 req-ade141cf-7fc8-4b7f-95f1-13c3bec19916 service nova] Creating event network-vif-deleted:3e9abda7-4473-4e3e-90a7-250c48b9e389 for instance 6abbc929-0be3-4234-926d-4544e48edcac on hv-cinder-83608 Aug 10 23:09:54.130685 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [req-890291e7-79a4-4397-ba19-1ea1198dd6e8 req-ade141cf-7fc8-4b7f-95f1-13c3bec19916 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Aug 10 23:09:54.131269 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 699/1384] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:54.560877 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:54.561462 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: 6abbc929-0be3-4234-926d-4544e48edcac] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:54.568660 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:54.569146 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:54.569615 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:54.570311 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:54.570765 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:54.571193 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:54.584962 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] HTTP exception thrown: Instance 6abbc929-0be3-4234-926d-4544e48edcac could not be found. Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Request method failure captured: Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac HTTP/1.1 Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9Dif4-h3Vp-bA0jwM2QN4czZqwAYSUTByS0WtK4lQu0pDhIiPOkAuSUxmQMM6DibalLQz_97OrWWP5mQc5IMJaLbrutpbKMCEPD9hGNtQpUwRIJymSxObAjowvZAxEug_HBbAnqXJ5_FyoSzd7uh45ssTtzZ2waCHYBTWKWU7r0wfuY Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:09:54.586642 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}] Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: bc550ece01ba4d36adc64dbb963d38d4 Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance 6abbc929-0be3-4234-926d-4544e48edcac could not be found. Aug 10 23:09:54.588469 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': '6abbc929-0be3-4234-926d-4544e48edcac'} Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6abbc929-0be3-4234-926d-4544e48edcac could not be found. Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:54.589558 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6abbc929-0be3-4234-926d-4544e48edcac could not be found. Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6abbc929-0be3-4234-926d-4544e48edcac could not be found. Aug 10 23:09:54.590934 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:54.592370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Returning 404 to user: Instance 6abbc929-0be3-4234-926d-4544e48edcac could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:54.592370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-4d285ff9-3e11-45a1-b0d4-2a335c1d2096 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac" status: 404 len: 111 microversion: 2.1 time: 0.031977 Aug 10 23:09:54.592370 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 686/1385] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:54 2022] GET /compute/v2.1/servers/6abbc929-0be3-4234-926d-4544e48edcac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:55.039028 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:55.039606 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.compute.api [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132540) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:55.045994 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:55.046473 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:55.046905 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:55.047590 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:55.048042 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:55.048463 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG oslo_concurrency.lockutils [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:55.061334 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.wsgi [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] HTTP exception thrown: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Request method failure captured: Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: request: DELETE /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 HTTP/1.1 Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept: application/json Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Accept-Encoding: identity Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Connection: close Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Length: 0 Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Content-Type: application/json Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Host: 10.222.0.76 Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Openstack-System-Scope: None Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Auth-Token: gAAAAABi9Dif4-h3Vp-bA0jwM2QN4czZqwAYSUTByS0WtK4lQu0pDhIiPOkAuSUxmQMM6DibalLQz_97OrWWP5mQc5IMJaLbrutpbKMCEPD9hGNtQpUwRIJymSxObAjowvZAxEug_HBbAnqXJ5_FyoSzd7uh45ssTtzZ2waCHYBTWKWU7r0wfuY Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Id: None Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Domain-Name: None Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Identity-Status: Confirmed Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Is-Admin-Project: True Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Id: default Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Domain-Name: Default Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Project-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Role: member,reader Aug 10 23:09:55.062966 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Roles: member,reader Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}] Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-Tenant-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Id: default Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Domain-Name: Default Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Id: bc550ece01ba4d36adc64dbb963d38d4 Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: X-User-Name: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: method: > Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: exception: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.064709 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: action_args: {'id': 'd1f83a38-e7a5-4d04-8336-6e23f442c8d2'} Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:55.066113 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.067759 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.069474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Returning 404 to user: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. {{(pid=132540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:55.069474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-329f77e0-445a-4e2c-a28d-022175918051 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 404 len: 111 microversion: 2.1 time: 0.029547 Aug 10 23:09:55.069474 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 700/1386] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:55 2022] DELETE /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:55.073603 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '>' {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:55.074208 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.compute.api [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] [instance: d1f83a38-e7a5-4d04-8336-6e23f442c8d2] Fetching instance by UUID {{(pid=132541) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:55.080058 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:55.080535 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:55.080970 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:55.081686 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Acquiring lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:55.082137 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:55.082559 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG oslo_concurrency.lockutils [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Lock "c55dad4d-2bd6-411b-a14d-21f8d7cc466a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:55.096233 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.wsgi [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] HTTP exception thrown: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Request method failure captured: Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: request: GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 HTTP/1.1 Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept: application/json Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Accept-Encoding: identity Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Connection: close Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Length: 0 Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Content-Type: application/json Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Host: 10.222.0.76 Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Openstack-System-Scope: None Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Auth-Token: gAAAAABi9Dif4-h3Vp-bA0jwM2QN4czZqwAYSUTByS0WtK4lQu0pDhIiPOkAuSUxmQMM6DibalLQz_97OrWWP5mQc5IMJaLbrutpbKMCEPD9hGNtQpUwRIJymSxObAjowvZAxEug_HBbAnqXJ5_FyoSzd7uh45ssTtzZ2waCHYBTWKWU7r0wfuY Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Id: None Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Domain-Name: None Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Identity-Status: Confirmed Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Is-Admin-Project: True Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Id: default Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Domain-Name: Default Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Project-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Role: member,reader Aug 10 23:09:55.097775 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Roles: member,reader Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_19b7bdf29e5d4fad87f8991179fc46ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/19b7bdf29e5d4fad87f8991179fc46ea"}]}] Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Id: 19b7bdf29e5d4fad87f8991179fc46ea Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-Tenant-Name: tempest-TestVolumeBootPattern-755905585 Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Id: default Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Domain-Name: Default Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Id: bc550ece01ba4d36adc64dbb963d38d4 Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: X-User-Name: tempest-TestVolumeBootPattern-755905585-project Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: method: > Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: exception: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.099502 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: action_args: {'id': 'd1f83a38-e7a5-4d04-8336-6e23f442c8d2'} Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: {{(pid=132541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:55.100643 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. Aug 10 23:09:55.102313 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: ERROR nova.api.openstack.wsgi Aug 10 23:09:55.103904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: DEBUG nova.api.openstack.wsgi [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Returning 404 to user: Instance d1f83a38-e7a5-4d04-8336-6e23f442c8d2 could not be found. {{(pid=132541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:55.103904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO nova.api.openstack.requestlog [None req-196b2d3d-6683-4f30-9b86-96c15aa0080a tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2" status: 404 len: 111 microversion: 2.1 time: 0.029830 Aug 10 23:09:55.103904 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: [pid: 132541|app: 0|req: 687/1387] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:55 2022] GET /compute/v2.1/servers/d1f83a38-e7a5-4d04-8336-6e23f442c8d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:56.405769 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: DEBUG nova.api.openstack.wsgi [None req-16a3fb90-5e21-4d36-8b0f-f8ab58356d93 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] Calling method '.version_select at 0x7fa9c2dcd670>' {{(pid=132540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:56.433360 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO nova.api.openstack.requestlog [None req-16a3fb90-5e21-4d36-8b0f-f8ab58356d93 tempest-TestVolumeBootPattern-755905585 tempest-TestVolumeBootPattern-755905585-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1709271121" status: 202 len: 0 microversion: 2.1 time: 0.031339 Aug 10 23:09:56.434338 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: [pid: 132540|app: 0|req: 701/1388] 10.222.0.76 () {58 vars in 1263 bytes} [Wed Aug 10 23:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1709271121 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:12:33.483350 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:12:33.483913 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:12:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:12:41.957169 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:12:41.957736 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:12:42.461255 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:12:42.461914 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:12:42.983277 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:12:42.983958 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:12:57.418744 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:12:57.419303 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:12:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:15:02.013152 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:15:02.013831 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:15:53.492971 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:15:53.493522 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:16:01.965388 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:16:01.966143 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:16:02.469697 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:16:02.470225 dv-cinder-836083-12-iscsi devstack@n-api.service[132541]: Wed Aug 10 23:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:16:02.991967 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:16:02.992525 dv-cinder-836083-12-iscsi devstack@n-api.service[132540]: Wed Aug 10 23:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!